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ABSTRACT 


The game of three-dimensional Tic-Tac-Toe ("Qubic') has been 


analyzed from a point of view distinct from the normal minimax 
intermediate-evaluation standpoint. Certain pruning strat- 
egies have been developed based on the concept of forcing 
moves, confining attention to planes inside the board. The 
pruning is drastic enough to enable analysis to the end of 

the game, reducing the need for intermediate evaluation to a 
minimum. 

Two computer programs, one on the PDP-4 (with a 340 D 
scope display unit) and one on the UNIVAC 1107, have been 
deveited. The level of sophistication of the two programs 
is different (based on two different levels of strategies 
discussed in the paper), and a comparison of games played by 


the two makes an interesting study. 
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1. INTRODUCTION 


In the summer of 1962, a checker playing computer 
defeated one of the nations foremost Slaveeas Amazingly, 
the machine was programmed by a man who knew comparatively 
little about the complex strategies of the game. 

This and similar achievements fall into the realm of. 
artificial intelligence, a promising field in which computer 
programs are being constructed to exhibit behavior that may 
be called “intelligent behavior" when it is observed in 
human eines such research, it is hoped, will lead to the 
development of techniques and devices to relieve human beings 
of various complex baci: 

Of the many different research paths being explored in 
the field of artificial intelligence, perhaps the most 
fascinating to the researcher is game playing. Game environ- 
ments are useful in studying the nature and structure of 
sous reblen solving processes, and, in addition, provide 
man the amusing opportunity to challenge his wits against a 
ee The relatively highly regular and well defined pro- 
blem environments characteristic of games in general “provide 
an excellent foundation for the use of intelligence and 
symbolic reasoning skills. Symbolism rather than numeric s 
come directly under stay: | 


~] =) 


ee 


A thorough understanding of the theory of the game 
playing should help us to formulate problems which are closer 
to realistic sepiueatione. Many game playing situations (such 
as in chess) exhibit a complexity of structure beyond those 
of the problem solving situations one normally encounters in 
everyday life (provided the intangibles of the real-life 
Situation can somehow be ener a A primary difference be- 
tween game playing and actual problem solving situations lies 
in the origin of the cndsriaintion: In a game, the uncertain- 
ties of the problem result from the large number of alter- 
natives available, while the objective as well as the rules 
are rather simply sraise. However, in many aotual problem 
solving situations, the uncertainties are essential attributes 
resulting from an imperfect knowledge of the eavisoanent. 
Furthermore, the problem itself is stated in a fairly complex 
manner, involving a large number of eee. Hence; the 
study of game playing might be relevant to only those real- 
life problems in which the structure remains complex even 
after the removal of the inteagiiies, 

Perhaps an even better approach to problem solving 


would be the theoretical development of a formal theory — 


offering a guideline on how to deal with these problems , (8911) 


Such a theory must of necessity be of a general nature since 
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problem solving situations are exceedingly difficult to 
classify and group into ice: Most realistic problems are 
poorly structured and have their own specific features. The 
results and procedures recommended by a formal theory would 
have to be supplemented with additional specifications to 
meet the needs of the specific problem at hand. The theory 
must offer the principles to be observed when dealing with a 
given problem as well as indicate the structure of the pro- 
blem solving Sad seee | The specifics of the problem have to 
be designated by observance of the immediate problem under 
consideration. 

The game which has received the most attention thus far 
in artificial intelligence is chess, Obviously, any game 
which is sufficiently complex and subtle in its implications 
to have allowed a deepening analysis through centuries of 
intensive study and play without becoming exhausted is an 
excellent target for machine studies. A successful chess 
playing machine would signify an achievement penetrating to 
the core of human intellectual smieaton In 1949, Shannon‘) 
presented a paper in which he pointed out that although chess 
is a finite game (there are only a finite number of positions, 
each of which admits a finite number of move alternatives) , 


application of a minimaxing technique would be impossible on 


ae ae 


even the fastest digital computer because of the large number 
of possibilities that must be explored. He estimated that 
- there are scpromimabely aC” move possibilities as contrasted 


to only 10°° 


microseconds in a century. Shannon's proposal 
was that minimax continuations be explored to a certain 
practical depth and static evaluations then be made to deter- 
mine the move with the highest sbrociivacvaiue, The greater 
the depth of analysis, the better the chess that would be 
saved: He proposed a numerical measure, based on various 
features that chess experts sousidar augeeiant, be formed 
by summing a number of factors that could be ssnpeted for any 
sseceiat, This has come to be known as intermediate evalua- 
oon While Shannon did not present a particular computer 
program his specifications helped pave the way for programs 


by Turing (15) 


in 1951, Kisler, Stein, Ulam, Walden, and 
We11s‘*) (Los Alamos group) in 1956, Bernstein, Roberts, — 
Arbuckle, and Belsky‘°) in 1957,and by Newell, Shaw, and 
Simon ‘*) in 1958. The latter effort breaks away slightly 
from the now conventional minimax - intermediate evaluation 
schema and approaches the game more as a model of human 
problem solving in the chess sieoument. The authors are 
apparently convinced that human-like problem solving methods 


would be more effective in chess problem solving than other 


nae ae 


computational schemes that had been proposed and tried. Their 
conviction is supported by the comparatively fine behavior 
of their chess playing en 

An excellent rebuttal to their approach might be voiced 


(5) 


by Samuel » whose checker-playing program might be considered 
the classic achievement in game playing in artificial intell- 
igence to dete. Through the use of learning routines the 
program has progressed from an initial classification of 
"hoor player" to the point it can defeat recognized sicacions: 
It's position evaluation scheme and minimaxing techniques 
place it clearly in the "pure" artificial intelligence area, 
free from human-like problem solving icchahs ous. Perhaps 
the most interesting result of Samuel's program is the 
possible conclusion that man is capable of solving problems 
without knowing precisely how he solves esi 

A game need not be as complex as chess or checkers to 
prove of eee Various programs have been written for 
simpler games such as two dimensional (3x3) tic-tac-toe. 
The Sransetieel ers is small enough for the computer to 
determine the optimal move in the very beginning of the game, 
Such a machine is currently on display at the New York 
World's Fair, By its trivial nature, two dimensional tic-tac- 


toe provides an excellent structure to test and observe 
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simple rote learning procedures‘”?, 


A more sophisticated attempt at machine learning has been 


presented by Wexelblat ‘24) 


using the game of Renjyu. This. 
game is played on the vertices of a 19x19 board; a win 

_ being 5 in a row in either a horizontal or vertical direction. 
_ Wexelblat's learning procedure considers only the end-game 
for its strategic evaluations, virtually ignoring all 
offensive and defensive moves in the opening and middle-game., 
Since a game of Renjyu between two good players may have — 
several blocked threats before Whe. ftw ons it ie -ameeant 
that much of the strategy is missed by failing to consider 
the middle-game. 

A well-known game of relatively the same order of | 
difficulty as Henjyu is three dimensional tic-tac-toe played 
in the cells of a 4x4x4 sais This is a particularly attrac- 
tive game for investigation as it contains the basic 
characteristics of an intellectual activity in which heuristic 
processes play a basic ites Some of the important character- 
istics of three-dimensional tic-tac-toe include: | 

1. The game is or can be made familiar to a substantial 

body of nsopie, This is important so that the behavior 

of the program can be made understandable to them. 


&. The rules are definite and are known, It is this 


ny ee 


characteristic which many practical problems fail to 
es Important problems such as war games and economic 
processes have no definite known rules. 

5, A definite goal exists - winning the game. In 
addition an intermediate or sub-goal which has a bearing 
on the final goal also exists. This will be discussed 
eo 

4, The game is finite, yet not deterministic in the 
practical seed An exploration of all possible paths 
would envolve approximately 10°° choices of moves, which 
at three choices per microsecond (far faster than the 
speediest existing computer) would still require a 
hundred million years. 

5. There are no probabilistic decisions such as roll 

of dice, toss of coin, etc, 

6. There is no concealing of informtion by either 
player as to his last move. Thus the state of the game 
is sieve known by both players. | 

| The game of three-dimensional tic-tac-toe has been 


(6) 


investigated by Daly‘~’. In his paper "Computer Strategies 
for the Game of Qubic", he applies the techniques of minimax 
and intermediate evaluation to yield an effective game playing 


machine, His approach is similar in this respect to that of 


Samuel in checkers. Daly attempts no learning procedure, 
however, because of the limited number of abstract strategies 
and concepts available, and the limitations of the computer 
used, 

Although Daly recognizes that a strategy might be drawn 
from concepts concerning planar arrangements in the cube, he 
concludes that such patterns are not suited for machine use, 
though they might be useful to human players, Perhaps this 
is too hasty a brush-off of human-like heuristics in favor of 
the minimax-intermediate evaluation approach in a game which 
admittedly contains comparatively few abstract strategies 
and concepts. Even in the far more complicated game of chess, 
Newell, Shaw, and Simon‘! consider human heuristics superior 
to machine-like play. In their introduction they state; 

"We have now completed our survey of attempts 

to program computers to play chess, There is clearly 

evident in this succession of efforts a steady 

development toward the use of more and more complex 
programs and more and more selective heuristics, 

and toward the use of principles of play similar to 

those used by human players. We believe that any 

processing system - a human, a computer or any other - 
that plays chess successfully will use heuristics 
generally similar to humans," 

The planar forcing techniques mentioned by Daly will 
be expanded in this paper to yield an alternate approach to 


the abstract minimax~intermediate evaluation technique based 


on a deeper reliance on heuristics and human-like problem 


SO es 


solving acthede: The success of this alternative formulation 
‘indicates that the secmmacies of minimax and intermediate 
evaluation may be only one aspect of the general theory of 
strategy - of which another sate has been studied here, 

In what follows, an indication will be made of a possible 


form which such a theory might take. 


2, A SYSTEMS THEORY APPROACH TO STRATEGY AND GAME PIA YING 


The concept of oe ee be applied to anes anl game | 
theory has been discussed in eine reuse piviteations ax eeent 
eee, Mathematical eacnmiases have an Pomantated a eee 
dict and determine the outcome of or Siac eens ee conse: 
A great deal of the research has been diectea coward the 
application of mathematics Been aauis ibis: dbaeve, 
contrary to the success of mathematics in other sciences, it 
has done little to improve existing economic enouliedee. It's 
failure has led to : recent Hew point that the foundation 
of the present theory is not deep enough and that a theory of 
“problem solving might be the key to the clarification and 
Gadens tending Gt couples eroplenes The: thecery ef problem 
solving is evolving from a “systems approach" baveticn the 
development and analysis of general models for problem solving 
seatene: In a recent paper, Windeknecht 1?) illustrated the 
technique of "isomorphic systems" in which he demonstrated 
the aaoeons snpreevousanee between a derived model of one- 
person games and a finite autouation. His mathematical model 
and corresponding analogy is used to shed light on the out- 
come of one-person sane, 

In this paper an attempt is made to define many of the | 
concepts and applicable terminology to postulate a simple 


a Oh ae 
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model of games in a discussion of eeatee for a particular 
type of a The discussion is directed toward a "finite, 
perfect information, two-person game" in which "chance" is 
not present (in the sense that die are not thrown, cards are 
not drawn, so.) Only games of pure opposition in which 
the outcome is win, lose, or draw are seusaexed Games of 
this type include chess, checkers, tic-tac-toe, nim, etc, 

Let us begin by defining what is meant by a "strategy". 
A strategy of a player in a given game is a complete plan of 
behavior which specifies the player's decisions for all 
possible circumstances that may arise during the course of 
play. 

One can easily imagine that a player does not make his 
individual decisions as the occasions gies during the course 
of play, but that he chooses a complete plan oF Donaeion 
before the beginning of the parse In other words, he selects 
a strategy which determines all the individual decisions that 
may be required during the actual course of Sigs: Clearly, 
this does not leave the player with fewer possibilities then 
if he were to make successive decisions during the course of 
play. His freedom of action is not restricted. In fact, by 
choosing a strategy, the player makes more decisions than he 
actually needs; only part of all possible circumstances can 


arise during the actual course of play. All rules of behavior 


a ee 


applying to circumstances which do not arise during the course 
of play seareaudaaane. On the other hand, introducing these 
additional redundant decisions provides’ the formal advantage 
that the various decisions ee during the course of play 
can be combined into a single decision made before the game, 
This advantage is retained even if the concept of strategy 


is modified as indicated later, In general, a strategy not 


only contains decisions for circumstances which may not arise 
during the actual course of play; but it also contains 
decisions for circumstances which can not possibly arise. 
Owing to the decision provided by a strategy for a given 
Situation, certain subsequent circumstances may be axeiudea 
although they would otherwise have been possible, For 
instance, if, in a game of checkers, a strategy calls for a 
specific move yielding circumstance 6 from circumstance ay: 
then circumstance 6' arising from a by means of a different 
move cannot arise, Decisions for such nonrealizable cir- 
cumstances need not be made, of course, and the concept of - 
strategy as a complete plan of behavior can be modified 
accordingly, Jt would seem that for some purposes such as 
the proof of theorems in formal logics, the original concept 
of strategy as a complete plan of behavior is more appropriate; 
while for the study of particular games, the modified concept 


might be best. . 


oa ae 


A deeper understanding of the concepts involved in 
strategy can be obtained by considering the framework about 
which strategies are built, For this one must precisely 
define some of the terms necessary in the discussion. 

A "game" may be defined as the totality of rules which 
describe it. The abstract concept of a game is tobe dis- 
tinguished from the individual "plays" of that game in that 
a "play" is a particular instance at which the game is played 
from beginning to end, The component element of the game , the 
'move't, is the abstract occasion of a choice by either player 
between various alternatives under Saeeas precisely des- 
cribed by the rules of the aie The specific sewaciee 

chosen in a given instance in a play of the game is fhe "choice", 
Moves are related to choices in the same way as the game is 
to the play: the game consists of a sequence of ore the 
play of a sequence of epee. The "rules" of the game must 
be considered absolute in the sense that an infraction of the 
rules, by definition, changes the nature of the se Under 
no circumstances should the rules of the game be confused with 
the players' power to use or reject a particular strategy, be 
it good or bad. As previously mentioned, this paper is only 
concerned with those games which are “finite and contain | 


"perfect information", Such games are limited by their rules 
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to a finite number of states, and have the property that the 
complete state of the game is known by each player at every 
specific move time, 

Consider the game [ of two players X and Y, The play 
of the game consists of a sequence of mouse whose number can 
be denoted ty the integer v (since we are considering finite 
or The moves themselves can be denoted by the sets 


M and M_, 
x J 


; Uxypeeeayh where v = ntm 
Mi 7 { J, sVoa+e¥} | 

Any move x, (Ge1,25...0) or y, (GAL,2,...m) is a choice made 

from a number of alternatives, Move x, is thus chosen from 


the set 


te, (2) xx, (2) ’ .x, (a) 


where a, is the total number of alternatives : for move i 
of player x, 

Let Q be the set of all possible situations which may 
arise in - Each "particular situation" (i.e. element of 2) 
will be referred to as a "state of re, Thus, the set 0 will 
be called the complete state eet and will be finite in many 
cases of iutenset Any element of GQ may be obtained by a 


proper succession of elements from M, and M y as specified by 
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the rules of the game. Because of this unique formation of 
the elements of the set, the state set Nis said es -eonteaa 
"connected" elements, Any pair of states a,b (where a,b € Q) 
are said to be "connected" if and only if there exists a 


sequence of inputs { X1 2Xp900.x,} to the system such that 


£(£(,..£(£(£ (a, xp) 5% g) ++) 5 4) 9%,) =b 
where f is the state transition function mapping a state 
and an input (a move) into a new state. The "order of a 
connection" is the number of moves that separate the states 
in susetieis Thus, the order of connection of a fs b isnif h 
moves are required to take the game from state a to state b. 
Let us denote those elements of © which correspond to 


a win for X as 2, and those which correspond to a win for fY 


as O,. It is @bvious that these two subsets are disjoint. 
A tie game or draw can be denoted by a third subset Oh « Note 
that whereas On is complete in tic-tac-toe, a tie in check- 
ers might depend on a prescribed number of inconsequential 
moves, no one of which leads to a state in One More will be 
said about tie games later. 

The prime objective of player X is to achieve an 2. 


state before his opponent can achieve an OQ, state, Should 


the prime objective be impossible, a lesser goal would be a 


ae see 


draw game 3 — keeping Y from achieving a state in Ny 
Consider the state transition function f which maps 
the Cartesian product of a given ee and an X move into 
another possible state Gus: some state which is a first 
order connection to the given state). Similarly let g be 
the corresponding function for Y, 
Expressing the above in functional notation we have: 


Move fr Ao 
Saat | 
choice o 3B +9 


where: 
n 
Aca*f{y x, \ 
iL=1 
mi 
ef 
BeQ {U y; \ 
i= 


Goals of X and Y: 
Primary goal of X: 2, <A 
Primary goal of Y: Qy nn ®) 


Secondary goal of X and Y: MC Q 


Relations between goals: 


AN oy = 49 
A Ao = 9 
a, Vo, = 4 


a 


The game itself may be modeled as a simple system of 
state transitions dependent upon the functions f and ¢. 


5, = b (b € Q) 


f ( 


254s.” So4_1? X4) 


So, = 8 (Sos_42 Yq) 


The primary objective of player X can be expressed as a 
recursive function which takes into account the move choice 


of player Y, Bote 'X-strategy" as a function, 


Fi Q >{U X5 } 


Given an X-strategy one can associate a mapping between 
a sequence { ys} of moves made by Y and a sequence of states 


{b, } (b, € ©) such that: 


b, = g(£(b,_13 FL(b,_1))> yz) 5 2 = 152,...n 


bo = the starting state 
The strategy F, will be called a "primary X-strategy" if: 


(1) For all i and for all y, b, # QU 2, 
(2) For all y there exists n such that b & 2. 
It is obvious that such a strategy might not be realizable. 


Thus, define a "secondary X-strategy" as one in which only 


condition (1) is realized, The definition of an X-strategy 
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eee out the feedback attribute characteristic of re 
A state of the game along with the strategy determines the 
stageuiaiedes The move together with the previous state 
determines the new aaa. This process continues until the 
game terminates, Jt may be represented in block diagram as 


shown in Figure 2.1 


Figure Rel 


The game shown in Figure 1 begins at point "a" 
if Y moves first, and at point b if X moves first. A move 
sequence requires cycling through the points b,c,a,d 
respectively. 
tet us now consider the characteristics of a primary 


X-Strategy. This strategy considers sequences in which for 
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any y, (k) € y, in the move sequence, an x, (k) éx, is 
available such that eventually the sequence will terminate in 
Qe Furthermore, the definition excludes the possibility of 
the sequence ever entering into a state within the set O.. 

In some very simple games, such as nim, a primary X-strategy 
may be applied on the first move, guaranteeing a win for the 
first player. In others such as tic-tac-toe (3x3) - such 
strategy exists, and a win may be achieved only through a 
poor move on the part of the opponent. Thus, a secondary 
X-strategy would be applicable to tic-tac-toe. 

In a more complicated game such as checkers, it is not 
obvious whether or not a primary or even secondary X-strategy 
exists on the first oe Intuition points to the Likely 
possibility that the first player should be able to do no 
worse than tie in checkers, but this has yet to be proven. 
Perhaps the best strategic attack to games in which an 
X-strategy is not immediately evident is to decide on a set 
of states Q, called the strategic sets which are advantageous 
in the eaves that each forms the basis of a ee ee 
A strategic set of states Og cM has the property that for 


any sequence mM 


M = fy sae 
y { %q? Yq+l?  } 


OO 


there exists'a sequence Mes 


i: 1 %q! Xgl? °°* “p } 

such that Done E 2 if > € Oe (where the subscript on 
b € 9 corresponds coe subscripts on moves in M, eng 
_ yielding this state). — _ 
Once a primary X-strategy has been started, the two~ 
paneon eons eon be considered as having degenerated into 
a one-person game Since the outcome is dependent only on 
the moves of the second player. A one-person game has the 
advantage that the player has complete control over the 
state transformations; once a transformation is chosen, 
only one outcome is sontiie, | 

A sub-strategic set of States Ny CN may be defined 
as those states pe vere the property that for any Seauence 
M { yys¥ qtl? **° y ot there ea ete a Re ente 


e (itd 20s, 


x“ {% ; qe? * ao ++ x} such that b, q 


eptl 
| The sub-strategic set Mg Ig As related to the secondary X- 
strategy in the same manner as the BUraHSe SS set M, is 
eeiated to the ee eee As previously pints 
out, a draw is possible in many games :ahot cicenine a 

- state which is an element of Mp. In many cases, the draw is 


so declared by the rules of the game to prevent an infinite 


ey 
sequence of moves, A sequence of this type, known as a 
'thain}' is defined as follows: Let oF be an arbitrary subset 
of 9, om is said to be a chain if and only if there exists 


an ordering of its elements, say QO, = {by sbys--b,} such thats 


ul 


(bs) = bia) 


h(b, ) b) 


(i as hey are ® .n~1) 


where h is a state transition function related to f and g. 
Obviously, a chain is not a "stable" set in the sence 

sause (e2 for all games containing a draw) since it is 
dependent on the whims of two individuals. Thus, game rules 
suns provide that a draw be declared when a preassigned 
number of "inconsequential" moves eveaeds in succession, 
However, it may be conjectured that continuation of sequences 
of "inconsequential" moves seueragentasay lead to a chain 
anyway. 

Let us now consider the nature of the state set more 
closely. A first order connection to some state bo € Q might 
consist of any one of the elements of the set bc Q5 
(i = 1,2,...n). The set b, may thus be considered a subset 
in which can be reached from the state bo. Emanating from 
every element of the b, is another subset in 0, 
beg (FS 1yeeeacm)s each of whose elements is a first order 


iJ 
connection to a state in b, and a second order connection to 


nee 


bo» To illustrate, b,, represents the third of n possible 


34 
choices as a first order connection to bo» and the fourth of 
-m possible choices as a first order connection to ba. Con- 
tinuing in this manner, the state of the game may be repre- 
sented at any time as an element Ps sa..eg OF the set . 
| This labeling of states might be termed a "connective number- 
ing system". | 
hs “abinaebive numbering system model of a game leads 

to the concept of a "tree", an artifice which is used 
extensively in game theory literature. The alternatives 
available to progress from one state to a first order 
connection give rise to the "branches" of the tree, A | 
simple tree configuration with the connective numbering 


system is shown below in Figure eves. 


Figure 2.2 


The tree representation clearly shows a prime difficulty 


in dealing with games: the number of possibilities grows 


exponentially with move number as viewed from the initial 


i OR as 


state. Actually, the system has an additional complexity. 
One need only be vaguely familiar with games to realize 
that some states may be reached by several alternatives. 


Thus b,. might be the same state as b.. or b Consequently, 


a1 68 134° 
the tree degenerates in a "net" which has the characteristic 
that flow may only proceed in one direction as shown in 


Figure 2.3. 


b 


12 Pell 


Figure 2,5 
The model of a game as a non-planar network of possible 
states best portrays the idea of "connection" presented 
soutien. 
The classical approach for determining a path through 
the game network leading to a desired final 565-40 a two- 
player game is known as the minimax technique. ‘In this 


method, the following question is asked recursively until 
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the net is exhausted and the end of the game has been 
autoruiveds "Where can move sac Aieeens ce sieien after 
my opponents move will be the best 1 can hope for should 
he make the best countermove?" While minimax is effective 
in trivial games, it is of little use in a complex game like 
chess where the possibilities to be explored exceed 1 128° 
A digital soubor checking at the fantastic rate of 6 Gowen 
per microsecond would reat an amount of time greater than 
the expected lifetime of our universe to check all these 
possibilities. Thus, the approach used in complex games is _ 
to reduce the depth of search through the net to some feasible 
Limit and to investigate the relative values of the end 

points of the sbaneh; “oN operation undertaken at these end 
points is usually aces on the status of various empirically 
established criteria considered to be important characteristics 
of the ee ee To be more explicit, consider the 
sets O, cn (i = ee where OF is a set of states 
beyiiesn eeeielo characteristic in a good strategy 


“might be to move to a state which is contained in the inter- 


1 


section of a number of the My » Lo illustrate, states b 


and by in Figure 2.4 are contained in the intersection of 


7 
Figure 2,4 


four sets belonging to O+ (i.e. By abe E O- 1) A; ‘a’ or ‘ater ), 

| 1 5 6 7 
It is quite possible that good criteria for intermediate 
evaluation coupled with a limited opening minimax application 
might lead to a state situation from which a primary or 
secondary X-strategy could be aeniea. 

In this case, the outcome of the game is render- 
ed deterministic if and only if the opponent follows the 
moves that the abbreviated minimax application shows to be 
his a However, the entire argument breaks down if the 
opponent chooses a path other than the minimax prediction. 
(In a game where minimax is used to find a path from a present 
state to the end of the game, a ous other than one predicted 
as his best a minimax technique will not aid the oppon- 


ent. On the other hand, in a game where minimax is limited 
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in depth, the evaluation of the alternatives may be in 
error, and the wasne path might Sareieeeas Such a possib- 
ility always exists due to the empirical nature of the 
evaluation criteria.) Thus, the technique of limited minimax 
and ietsnniiiave euaeetien might not be a good strategy 
- to follow in complex ere 

A very important factor a the minimax technique 
doce wot. Sonsider 2a the Sabin oF ane: opesnene.. TE 
a great deal is known about an opponent's reaction to 
specific situations, statistics can be set up which predict 
with a certain probability which alternative he will acca. 
It is certainly possible to conceive of quite elaborate 
schemes which could be used for saving information about a 
particular player in order to determine the best approach 
to take when playing Serer Entire games might be saved 
in order to obtain an estimation of how he will react to a 
given ssiaehisa This technique might be used in a situation 
which appears to yield a draw by conservative play using the 
minimax technique. "Daring" play backed by staunch aeobani ie 
istic criteria for success might convert such a situation 
into aieain while risking a loss should the opponent play 
the minimax pieetee. Carrying this reasoning one step 


further , a player should not use a strategy which can be 


a OF me 


detected and predicted by his opponent unless it will lead 
to a win regardless. In other words, a slight deviation 
from a consistent overall strategy for the express purpose 
of perplexing the opponent might enhance, the probability of 
obtaining the seat, | 

In lieu of the minimax technique, heuristics may be 
established to reach desired intermediate points or criteria 
or perhaps to reach as far as ie states Q . from which a 
primary X-strategy is available, The value of a heuristic 
may be characterized by its efficiency in getting to the 
desired state and its effectiveness in reducing the path 
search to achieve this goal. By the use of heuristics, 
the possible number of paths through the network is usually 
drastically "pruned", A strategy may thus be considered in 
this case as the use of a heuristic approach to the goal. 

The two primary strategic constituents of the two- 
person competitive class of games discussed may be summarized 
briefly as follows: 

1. Reasoning with heuristics that select fruitful 

paths of exploration in a space of possibilities that 

crows seronantialiy, 

2, ‘Using these heuristics to reach a state in which 


the fixing of the strategy of one decision maker renders 
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the system deterministic. . 

As pointed out in the introduction, the game of three 
dimensional tic-tac-toe is ideal for purposes of demonstrating 
the use of heuristic pevesnaad: The remainder of the paper 
will be devoted to a discussion of this game and a step-by~ 
step development of strategies and heuristics enabling a 


computer to play in a sophisticated manner, 


5. DESCRIPTION OF THE GAME 


Three dimensional tic-tac-toe is a finite, perfect 
information game played by two opponents on the 64 cells of 
a 4x4x4 cube (see Figure 51). Opponents alternate moves, 

a move being the occupation of any previously vacant cell 

in the abe Any position involving a straight line through 
the cube containing four cells occupied by the same player 
constitutes a win for that player, A two dimensional 
representation of the cube can be eee by breaking up 
the 4x4x4 configuration into four 4x4 ies. For identifi- 
cation purposes the cells can be numbered by specifying 
their coordinates on a three~-axis Cartesion system as shown 
in Figure 3.2. Of the three numbers assigned to each cell, 
the first identifies the level (L) of the esa: the. second 
identifies the row (R) within the level, and the third. | 
identifies the colum (C) within the level. : 

A total of 76 straight lines spniciniae four cells can 
be shown to exist in the subse Such lines will be peroneal 
to as "files", The 76 files can be classified into ares 
groups as follows: 

1. Variation of a coordinate with other eer Te 

escent G. File orthogonal to two aaa _— 


a, Variation of C with constant L and R 
(16 possibilities) 


DOs at 
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b, Variation of L with constant C and R 
(16 possibilities) 


ec. Variation of R with constant L and U 
(16 possibilities) 


2. Variation of two coordinates with constant third 
coordinate (i.e. File orthogonal to one axis) 


a. Variation of R and L with constant C 
(8 possibilities) 


b. Variation of R and C ith soautank Lo 
(8 possibilities) 


ec. Variation of L and C with One ane R 
(8 possibilities) 


7 Variation of all three eee, File 
orthogonal to no axes) 
ss "Cross" diagonals of cube (4 possibilities) 
Due to the eroesute of the diagonal files, some cells 
have more files passing through them than others, The eight 
| vertice cells asa Figure B.Ja) and the eight "core" cells 
(see Figure 3.1b) of the cube are contained in seven files 
while all the other cells in the cube are found in only four 
files. 
One can study in isolation the eighteen distinguishable 
4x4 planes (16 cells) which can be shown to be contained in 
the ibe, There are two distinct groups of classification. 
" Planes with a constant coordinate ce: planes 


| parallel to the plane formed by the intersection of any | 
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two axes) 


a. Sixteen cells with same L (4 possibilities) 
b. Sixteen cells with same R (4 possibilities) 


c, Sixteen cells with same C (4 possibilities) 
2. Planes formed by "side" and "cross" diagonals of cube 
(6 possibilities) 
A representative example of each of these two main groups 
are shown in Figure 5.3. As might be expected, all cells 
are not contained in the same number of planes, Each of the 
elght vertice cells and the eight core cells is a member of 


six planes; each of the other cells is contained in four 


planes, 


(a) Vertice cells (b) Core cells 


Figure 3,1 
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Figure 3.2 


(b) Group 2a 


Figure 3.3 


Carterian Numbering 
system 


4, ELEMENTARY APPROACH 
Since the ideal of minimaxing over an exponentially 


erowing game tree is impractical, one if forced to reduce 


the size of the search tree in various ways. One of these 

is the reduction of the depth of search - not going all the 
way to the end of the game tree, but to stop exploring at 
some set of intermediate points. The other consists of | 
'oruning" - where instead of looking at all possible 

branches emanating from a node, one looks at only those which, 
by some consideration, appear to be more "promising", We 
shall have later occassion to discuss this latter technique, 
Meanwhile, we should remind ourselves that in games where 

the final outcome is not a numerical~-value pay~off but 
merely consists of a "“win-or-lose" decision, minimax becomes 
a rather trivial operation, although one still calls it 
minimax. Consider a play of such a game between player X 
and an Saeseene. In the win-lose situation the value of a 
state with the opponent to move is a "win" if the value of 
all the states that can be reached from this state is a ee 
("State" as used here refers to a particular board con- 
figuration.) The value of a state with player X to move is a 
"win" if at least one state that can be reached from this 


state is a win, The relation between this definition of the 


set of "win" positions and the "strategic set" 0. of Chap. eis 


os 


“A 


to be noticed. 

In three dimensional eieztaeates let us designate the 
state of any file by an ordered pair of integers (x,y) where 
x is the number of cells in the file occupied by the player 
under consideration, and y is the number of cells occupied by 
| the opponent, A file designated by (x,y) will be called an 
txe-y rile", The player under consideration will = referred 
to as X,and his opponent as Y. 

The novice player in his first attempts at this game 
usually follows the sole strategy of blocking files which are 
O-3 (making them into 1-3 files); or, if none exist, building 
2-0 files into 3-0 files. It soon becomes obvious to the 
novice that the lone formation of a 3-0 file is of little 
use against an alert opponent. A "stronger" strategy is to 
strengthen the positioning of the pieces until a state is 
reached from which two 3-0 files can be formed simultaneously. 
On defense the objective is to keep the opponent from obtain- — 
ing the same opportunity. In the terminology of the last 
chapter, the set of winning states O for player Xx consists 
of all possibilities in which a 4-0 file will exist prior to 
the formation of a 0-4 rile. A state from which an X move 
yields two 3-0 files is obviously a third order connection to 


ome (i.e. In three moves - two by X and one by Y = the play 


se ge 


may terminate in a win for X, 

The formation of two 3-0 files can be achieved by a 
simple check on the state of the 76 files. Let us define a 
"related pair" as two e-0 files aiich intersect at a vacant 
cell. Moving to this vacant cell obviously produces a pair 
of 3-0 files. A strategy based on this small amount of 
information can be applied to a computer for use against 
human opposition (see, however, the next sestan),, A more 
complete discussion of the background for this strategy is 
presented in Appendix I. 

Essentially this related pair strategy consists of four 
basic questions rvosed in the following order: 

de Does the computer have a 3-0 file? 

b. Does the opponent have a 0-3 file? 

. Does the computer have a related pair? 

4. Does the opponent have a related pair? 

If the answer to any of these four questions is yes, 
proper action is ait, If the answer to all four questions 
is no, a move is made from a "preset" move list containing 
the 64 cells in a predetermined sudeu: The preset move list 
can be arranged to take advantage of those cells in the cube 
which are contained in seven different files (cube vertices 


and core cells) or it can simply be a random ordering of the 
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64 seine: 

A flow chart of the "related pair strategy" is shown in 
Figure 4.1. In addition to the basic four questions dis- 
cussed above, the flow chart cee several other pertinent 
saeeviGae: These are numbered in the flow chart and sreiend 
‘stow: 7 

| 1. An illegal move by the opposition would wreak havoc 
with the soneuteris Tile indexes and must be suerdsd 
ern Moving into an senpisd cell or moving into 
several cells siuenoonsiye mene constitute an illegal 
ne 
Re An initial check should be made to see if the 
opponent has formed an O-4 file and thus won the ao 
3, An initial check should be ae to see if all 
board positions are filled, leaving the game in a draw. 
4, Obviously questions (a) and (b) above used not 
asked until at least three moves have been made by the 
esas player, and questions (c) and (d) used not 
be asked until at least four moves have been nae. 
5. The dotted boxes labeled (5a) and (5b) du Bisuee 4 

"oredict" a win for the opponent in one ana two (opponent) 

moves peepectineia:. If desired, the computer can assume 


that the opponent will not overlook the available 0-3 


ne oO" 2 


file or related pair, and can concede the game at this 

point, The dotted box labeled (5c) might also lead to 

a concession if the following conditions are met: 

a. Opponent has a peieeed pair in addition 
to the O-3 file. 

_ Blocking the 0-3 file has not either 
blocked the related pair or yielded a 3-0 
file for the somata: 

Generation of a situation as described in the explan- 
ations of (Sc) involves a more complex process than the 
related pair strategy outlined, The simultaneous formation 
of a 3-0 file and a related pair forms a "stronger" 
strategy than the lone formation of a related pair since the 
former leads to a win while the latter can be blocked by an 
alert epensnt. Going one step further, the successive 
formation of 3-0 files leading eventually to the simul- 
taneous formation of a related oe and a 3-0 file constitutes 
an even higher strategical level, If no O-3 file can be | 
formed by the opponent in blocking the succession of 3-0 files, 
the force sequence will terminate in a victory for the offens- 
ive suayee. Thus, a situation in which the opponent is faced 
with losing immediately (by not blocking the 3-0 file) or 


losing further on (when a 3-0 file and related pair are formed 


Figure 4,1: Flow Chart of Related Pair Strategy 
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a SO: 


simultaneously) will be referred to as a "terminal forcing 


sequence", 


So. TERMINAL FORCING SEQUENCES 


A terminal forcing sequence may initiate a force to a 
win several moves prior to the termination of the play. Its 
basic premise at any move is the formation of a 3-0 file 
in such a manner as to provide a e-0 file for use on the 
following move, and the eventual simultaneous formation of a 
pair of 3-0 files, To simplify the verbal description of 
the formation of terminal forcing sequences let us define the 
counterforce Para as the set of states which contains a 
O-3 file whose uusccamied cell is not in a 2-0 file, 
Most terminal forcing sequences fall into two general 
sucess: (Examples will be provided in the next sisseen.) 
These cases provide sufficient but not necessary conditions 
for a terminal fencing doeeneey 
Case 1: If there are two or more 2-0 files initially, 
and if a sequence of 1-O and 2-0 files exists such that 
they (a) intersect each other at vacant cells; (b) 
intersect two of the e-O files at vacant cells, and 
(c) intersect the remaining 2-0 files at occupied cells; 
then a terminal forcing sequence can be executed pro- 
vided that (d) the sequential blocking does not establish 
a state indy. 
A Case 1 terminal forcing sequence can be executed by 
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moving to a vacant cell in a 2-0 file such as to leave a new 
2-0 file. This is always possible because each ¢-0 file 
intersects a 1-O file at a vacant cell. Since all initial 
1-O files in the sequence are constrained to intersect each 
other at vacant cells, this procedure can be repeated until 
a 3-O file is formed while making a 2-0 file out of the 1-0 
file intersecting an original e-O file, The resulting state 
will contain both a related pair and a 3-0 file. However, 
due to condition (d) on the preceding page, the probability of 
long range terminal forcing sequences is drastically reduced 
because of the possibility that the opponent will form an 
OQ, state while blocking a 3-0 file. 
Case &: If there is at least one e-O file initially, 
and if a sequence of 1-0 files exists such that they 
intersect each other at vacant cells, and Si-iswat 
one intersection involves more than two files; then a 
terminal forcing sequence can be executed provided that 
the sequential blocking does not establish a state 
ing B° 
The force procedure for Case 2 differs from that of Case 1 
in that a second 2-0 file to terminate the force must be set 


up. The procedure for this will be made clear by examples 


later on, Although a terminal forcing sequence is maximally 
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effective when saresmpatetie the entire 64 cell cube, it is 
most easily recognized, and there are far fewer cases to 

look for in a given 4x4 plane of the cube (eighteen such 
planes can be shown to saint) The terminal forcing sequences 
described in this chapter can be used to obtain an excellent 
tolanar sateen. In the next chapter, in addition to 
describing the planar strategy, examples and illustrations 


of the two cases of the terminal forcing sequences are given. 


6, PLANAR STRATEGY 


A terminal forcing sequence can often be Aecdouteed iy 
a given advantage in a 4x4 plane of the cube. Consider a 
plane in which X occupies four cells while Y occupies none. 
Such a plane will be called a 4-0 plane. The term "“excess~four 
plane" will denote a plane in which X occupies four cells 
more than Y, For purposes of simplicity the plane under 
consideration will be assumed to be disjoint from the remainder 
of the sibs: it can be shown by a process of exhaustion that 
every 4-0 plane which contains at least one e-O file is a 
state in a terminal forcing Beaten. (All but a very few of 
the oueiRis cases are covered by cases 1 and & in the pre- 
ceding saiess Of the 1820 possible configurations of 
four occupied cells in a set of sixteen, 1804 contain at 
least one 2-0 file and thus yield a terminal forcing sequence. 
There are only two basic configurations of 4-0 planes, each 
having eight symmetries, which do not have at east one e-0 
file. They are shown in Figure 6.1. Because of ‘sip 
resemblance to chess patterns, the configurations are labeled 
the "knight's position" and the Neastle's position", respect- 
ively. Although these two positional arrangements do not 
contain a 2-0 file they are still quite interesting from a 
forcing seakiciae. More will be said about them further on 
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in this chapter, 


"Knight's position" "Castle's position" 
Figure 6.1 


Several examples of the two cases of the terminal forcing 
sequence will be illustrated using a 4-0 plane. For purposes 
of discussion, the sixteen cells and the ten files in the 


plane will be numbered as shown in Figure 6.2. 


a: | | 
stelle 
Le besaste 
| 
| | (d) 


(a) gs ‘rel 
Cell numbering SO Lagonal iles 
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(b) 
"Row" files » Colum files 


Figure 6.2 
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Sequences of file intersections will be denoted by a 
shorthand notation as follows. The notation 10-35-7271, 
will be intenpestad to read: ‘Bile 10, a 2-0 file, intersects 
file 3, a 1-O file, at a vacant cell. File 3, a 1-O file, 
intersects file 2, a 1-0 file, at a vacant cell. File ée, 

a 1-0 file, intersects file 1, a 2-0 file, at a vacant cell," 
Example 1 Situation (figure 6.3a): X has two 2-0 files 
(4. 10) intersecting at the vacant cells (16, 4) 
of a 1-0 file (8). 
Force Procedure: Form a sequence of 2-0 and 1-0 
file intersections which begin and end with a 
2-0 file. This will be a terminal forcing sequence 
according to Case 1. The intersection seauence in 
this example ig: 10,—* 8-4, 
The move sequence is thus as follows: 
1. Move to cell 4, the intersection of 2-0 file 
10 with 1-O file 8, The opponent will move to 
cell 7 to block the 3-0 file. 
2, Move to cell 16, the intersection of the newly 
formed 2-0 file 8 and 2-0 file 4, Both of these 
files are now 3-0, guaranteeing a win, 
The completed terminal forcing sequence with the 


move order preserved by subscript notation (i.e.X 
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is the nh move by X in the force procedure) is 


shown in Figure 6.3b. 


Figure 6.3 

Example re Situation (figure 6.30): x has two ek-O files 

(1, 3) which date diiteuese tea by many 1-0 files 

(55 16 7485 9, 10), = 

vores Procedure: Form aa intersection sequence 

as follows: 1,—>8—79—>3,.. 
‘The exacsenion moves are thus to cells 4, 16, ll, 
and either 6 or §-dapendiue on which of tha two 
3-0 files Q dibogee to Biede, The complete force 
is in Pears 665d. Notice ae tne intersection 
sequence is not sages. Some of the other possib- 


ilities are: 


oe 27 ie 


a 1,-? 10-3 5—> 55 


dD, 1,-? 6 7 9-955 
C. 1,7 10-97-75, 
d. The reverse of all listed possibilities 
| ses 3, 510-1, etc.) 7 
We shall later discuss the importance of having 
such alternatives in view of the possibility of 
Q. states. 
Example 3 Situation (Figure 6.4a): X has two 2-0 files (1, 7) 
and four 1-0 files (3, 4, 5, 6) with a sequence of 


intersections at vacant cells, 


Force Procedure : id 5p 4 utp 6 — PZ —> 75 


This force sequence as shown in Figure 6.4b can 

be shorted by a recursive procedure in which the 
intersection sequence is studied again after each 
X - O move pair. Doing this, the force sequence 
can be shortened by one X move, The new move 
sequence, shown in Figure 6.4d is obtained by using 


the intersection sequence 5,—7 4» 9-»7 


rs a 


application of the 1;—»5 opening (see Figure 6.4c) 


of the original intersection section, 


after 


Figure 6,4 
Example 4 Situation: X has four 2-0 files (2, 3, 10, 6) 


and three 3-0 files (7, 8, 9) (Figure 6.5a) 
_ -Horce Procedure So? 9-78 —10,, (Figure 6,5b) 
Example 5 Situation: X has one R-O file and a file inter- 
| section at cell 16 involving two 1-0 files and one 
200 file (Figure 6.5). 
Force Procedure: (a) 994, 8 (b) 4575-75-78, 
(Figure 6.54) The force is broken up into two 
ee A force is made to reach the triple 
intersection making two or ies aks 2-0 files. 


Then a second force is initiated there following 


the Case 1 terminal forcing sequence procedure. 


et, SOL tee 


Figure 6.5 
Examples 1, 2, and 3 illustrate Case 1 sequences of growing 
length; example 4 illustrates a Case 1 sequence with more 
than two initial 2-0 files, From example 5 it is clear that 
terminal forcing sequence Case 2 is an extension of Case l, 
carrying with it an additional procedure. 

The planar terminal forcing sequences include far more 
situations than 4-0 planes or even excess-four planes, A 
largely majority of 3-0 planes and excess—three planes 
containing at least one 2-0 file can be shown to lead to a 
terminal forcing sequence, (A complete list of these 3-0 
planes is given in Appendix II,) Thus, the excess=three 
planes might correspond to some of the desirable intermediate 
points denoted by 9. in Chapter 2, An example of a Case 1 


I 
type 3-0 plane is shown in Figure 6.6 a,b and a Case 2 type in 
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Figure 6.6 c,d,e. in the Case @ situation the move to. 


Figure 6.6 


the triple file intersection at cell 6 cannot be made until 


a file passing through it is Rke-0O, The intersection sequence 


here is: (a) L892, 6 (figure 6.6d) (b) Row l0-*6,, 


(Figure 6.6e). 
Notice that the second portion of the intersection sequence 
cannot be 25-71-76, because a 0-3 file is formed in this 
sequence. This is ner gee found in the terminal 
forcing sequence cases. | 

Thus far the planar discussion has been limited to 
situations in which the plane is completely isolated from 
the rest of the pape. Roneiametion: Quite often there will 
be some 2-0 or O-2 files in the cube lying outside the plane 
under consideration and having a vacant cell in that plane. 


Let us first consider the case in which such a 0-2 file is 
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present, The forcing sequence must then be constructed to 
insure that this vacant cell is never available for occupation 
by the opponent since this will lead to an O, saieeion: The 
cell can be avoided altogether or simply used as an X move 
in the terminal forcing sequence. In the instance in which 
a 2-0 file in the cube has a vacant cell in the plane under 
study, the probability of the existence of a terminal forcing 
sequence being available is pieatly ducreaned: Moving to the 
vacant cell in the e-O0 file adds to the advantage in the plane 
since the opponent's move is forced out of the plane to block 
the 3-0 file. Applying this procedure one could convert a 
nonforcing es boeasiiee plane to an excess-four plane, most 
all of which yield a terminal forcing ren Extending 
this reasoning one step further, an excess-two plane (i.e. 
a e-0 plane, 3-1, plane ste.) containing a vacant cell which 
is in a 2-0 file outside the plane, and even an excess-one 
plane containing two vacant cells which are in 2-0 files out- 
side the plane constitute the threat of a possible terminal 
forcing sequence and thus are also states in OF 

The strong characteristic of all terminal forcing sequences 
is the complete disregard for any offensive threat on the 
part of the opponent (with the notable exception of a 0-3 file). 


The formation of a related pair by the opposition during a 
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terminal forcing sequence does not alter the outcome, No. 
opportunity will arise for the opponent to utilize the re- 
lated pair and form.a pair of 0-3 Files. 

In addition to terminal forcing sequences, other “weaker" 
move sequences leading to a — can be shown to exist. Re- 
call the "knight's" position shou aa Hieime eae. This 
4-0 plane does not yield a terminal forcing sequence as it 
has no 2-0 files. Assume this plane is isolated from the | 
cube and consider a move by X to cell 1 forming two 2-0 files 
(files 1 and 5), It can easily be verified that regardless 


of the opponent's reply to this move (unless it forms an 


O-3 file) a terminal forcing sequence can be initiated on 
the next move. Similarly a move to cell 16 in the castle's 
position in Figure 6.lb will lead to a terminal forcing 
sequence on the following _ Many excess-three planes 
which are not states in a terminal forcing sequence have 
styaiee properties. Consider, for example, the 3-0 plane 
shown in Figure 6.7a. An X move to cell 6 results in a win> 


regardless of the 0, move. Win sequences for several 0 


1 


moves are shown in Figure 6.7 b,c,dj;e. 


af 


a a 


Figure 6.7 


The obvious weakness in a non-forcing opening move lies 


in permitting the opponent to initiate his own terminal | 
forcing sequence elsewhere in the cube during this delay. 

A slightly "stronger" configuration of the non=terminal 
forcing sequence opening move type is shown in Figure 6.88 
(The reader might note that this 3-0 plane actually yields a 
terminal forcing sequence, but this fact will be overlooked.) 


An X move to cell 16 forms a related pair forcing the O, move 


aa 
to cell &, 4, 8, thus yielding a 4-1 plane which is the initial 
state in a terminal forcing sequence, The completed win 

possibilities are shown in Figure 6.8 b,c,d. Actually, however, 


the related pair formed by the X move does not prevent the 


opponent from initiating his own terminal forcing sequence 
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instead of blocking tie related eins In this sense it is 
no more effective than the example discussed in Pigare: 6,7, 
The advantage of the related pair force a the a ‘move is that 
it controls the opponents move to a few selected cells in the 
plane under consideration, rather than letting him build 2-0 


files in the cube which might have vacant cells in the plane. 


Figure 6.8 
Planar situations may araeg in which the related pair 
"force" occurs on the second or third move in the'"pseudo- 
forcing" sequence. Consider the example in Figure 6.98. The 
The opponents first move ereonesa by a 3-0 file in file 7. 
The 0, move, however, may be to either cell 10, 12 or 13 to 
block the related pair set up by files 3 and 10, Each of 
disse ties possible moves gives rise to a terminal forcing 


sequence for X as is shown in Figures 6.9 b,csd, respectively. 


Figure 6.9 


Let us term any move sequence of the types described in 


figures 6.7, 6.8, 6.9 which lead to a win as “pseudo-terminal 
forcing sequences", To summarize, a pseudo-terminal forcing 
sequence is a sequence of moves which leads to a win while 
containing a move which is not a strict force (e.g. a related 
pair force), A win Sequence can be executed provided that the 
opponent cannot start his own terminal forcing sequence at 

the non-forcing move juncture, 

A flow chart test to determine the existence of a terminal 
forcing sequence in an isolated plane is shown in Figure 6.10. 
A more practical test would include checking for the possibility 
of vacant cells in the plane which are contained in e-O0 or 


O-2 files outside the plane as previously discussed. The flow 


Ee 


chart does not make — of Case 1 and Case 2 conditions of 
the terminal forcing sequences since these "rules! are 
sufficient ine nok Adc gany condiciones Instead, a planar 
"search technique" is utilized, Basically this technique may 
be outlined as follows: | 
| 1. Check the states of all 18 planes in the cube. 
2, If there is a 4-0 plane a Sscudentenilast: rorciae 
sequence exists,and if the plane has a 2e+0 file, a 
‘terminal forcing eaauenes is present. For 5-0 planes, 
6-0 scunseseesae terminal. forcing sequence ee 
exists (since there is always at least one 2-0 file). 
5, If there is an excess-three (or more) plane try all 
possibilities to manufacture a terminal forcing 
sequence. (This is done by forming a tree like structure 
of vacant cells in 2-0 files.) 
4, Save move sequence of the terminal forcing sequence 
Sieeorened for use in play so that the next move in the 


- sequence will be readily available. 


Figure 6,10. Terminal Forcing Sequence (TFS) Flow Chart 
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As an example the flow chart test is applied to the 3-0 
planar situation shown in Figure 6.lla. Dots seeused to 
signify vacant cells in a0 files, The step-by-step sequence 
leads to a related pair at cell 10 in Figure 6.1ut and is 
quite smooth, the only saukee!: occurring in Figure 6.lle 
where the spaonent forms a 0-3 rile. eee deal of extra 
work is saved by the beutistie which considers emene an Xx 
in vacant eames cells of the plane which are in e-O files 
before other possibilities. Without. this heuristic the reader 
might verify that the solution to this example is quite in- 
jolved isos“ tne introduces. a considerable amount of - 
“pruning" into the game ee albeit at the sacrifice of Boas 
involved strategies af eester Genin, A more complex example 
, move dig a poor one and 


must eventually be changed. Fourteen steps are required for 


is shown in Figure 6,lea, Here the x 


this solution. 


Figure 6.11 
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Figure 6.11 (Continued) 


(c) no 280 file, 


erase x. 


(d) no 2-0 file, 


erase x 


Figure 6,12 


‘(g) no 2-0 file, (nh) O has 0+3 file, (4). 
erase x. erase A. and 0-5 
also erase X 
| 4 
and 0, 


Bs} | |) 


(j) no 2-0 file, — (k) O has 0-3 file, 
erase I, | erase X_ and O_, 
_ wee also erase X, and 
0,5 also erase X 
and 0,, also erase 
X, and 0, 


a] °s} |? 


(n) related pair 
at cell 9 | 


Figure 6.12 (Continued) 


7. CUBIC STRATEGY 


In this chapter we will consider a few game situations 
which lie beyond the planar realm but are relatively simple 
to dctack, Blementary sequences of Case 1 and 2 terminal 
forcing sequences are of this nature. The lowest form of 
Case 1 has already been illustrated in Figure 5.3b. The 
specific conditions for this force may be stated as follows: 
If a 1-0 file intersects two 2-0 files at vacant cells, a 
terminal forcing sequence exists if no O, state is formed by 
virtue of the opponent's blocking moves. 

The check for this situation is relatively simple. It 
requires monitoring the short intersection sequences of 2-0 
and 1-0 files in the sabe When applied to a planar situation 
it is possible that the Case 1 situation will be srcecat even 
when there is no X-excess in the rere In Figure 71 a 
4-5 plane, an X move to cell 4 or 16 (vacant cells in a 1-0 
file) simultaneously forms a $-0 file and a related pair, 
yielding a sie, Interesting configurations of this type in 
which the three files (two 2-O files and one 1-0 file) are | 


in different planes may occur. 


Figure 7.1 
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Another "cubic heuristic" may be derived as, a direct 
result of those ee planes which do not yield terminal 
senting sequences, Consider the situation in which two 
eseeeeas planes are excess~three a excess~two respect~ 
ively. further assume that the excess-three plane does not 
yield a terminal forcing sequence and that there are no cells 
in the excess~two planes which are vacant cells in e-0 files 
outside the sas. It is entirely possible that a sequence 
of forces in the excess-three plane exists which builds the 
excess-two planes into an excess-three (or more ) plane yield- 
ing terminal forcing sequence. Such a force sequence 
might be termed a'plane-plane terminal Forcing sequence, This 
result may be expanded to multiple plane intersections but the 
extension will not be considered here due to the complexities 
and search an involved, Actually, a multiple plane inter- 
section situation leading to a terminal forcing sequence might 
be more easily described in terms of a Case 1 or 2 terminal 


forcing sequence anyway. 


8. SUMMARY ~ GENERAL MOVE STRATEGY 


At this point let us piece together the fragments of 
strategy discussed in the preceding saeeke The goal of 
winning may be replaced by pursuing a wider objective or 
sub-goal, achieving a state in a terminal forcing sequence. 
The problem is thus - How does one achieve a state in a ter- 
minal forcing sequence? This question is not easily answered. 
Perhaps the outstanding characteristic of a forcing sequence 
in the overall cube is the presence of intersecting 2-O and/ 
or 1-0 files, In the plane the sequence may be recognized 
by the pattern of occupied cells or by the excess-cell advan- 
ieee. The objective in both cases (cubic and planar) centers 
around the early formation of 2-0 and 1-0 files (which in 
turn lead to the build up of plane seeaeen Thus it 
appears that a good opening move in a play of the game might 
be to a cell which lies in seven files and six planes. (Re- 
call that this characteristic is true of the eight vertice 
and eight core cells of the cube, All other cells lie in 
four files and four planes.) 

Although there is no concrete theoretical evidence, it 
appears from empirical observation that the player who opens 
the play has a definite advantage over his opponent. (This 
conclusion is quite sound intuitively since the first player 
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is the only one to ever have an advantage in the number of 
occupied cells.) Thus , it is shonabiy bast for the second. 
player to place more emphasis on defense than offense at 
least in his first few opening ee A good reply to the 
opening move, should the first player occupy one of the six- 
teen cells mentioned, might be a mirror image to this move 
sean the axes of symmetry of the gabe. This would block 
one of the seven O-] files and generate six 1-0 files at the 
same ‘de, ro offensive" move in which no 0-1 files are 
blocked but seven 1-0 files are formed might be a better 
choice if the first player did eae to one of the six- 
teens Bejoieei esa. 

After the first several moves, several questions should — 
be considered while pondering a proper a These questions , 
constituting a general strategy, are posed in the flow chart 
in Figure. 8.1, This chart represents a far more sophisticated 
strategy than that shown in Figure 4.1. Several of the | 
mechanical MeEticuar Cle. how many moves are on the board) 
introduced in Figure Boi easel repeated in this flow chart 
although they still are pertinent, The term XWATCH cells 
used in the flow chart refers to vacant cells in the abe 
under consideration which are in &-O files outside the save. 


Similarly, OWATCH cells are such vacant cells in the O-2 files. 
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The final block in the flow chart - "Build a future 
threat" - may be fulfilled by either of two nossibilities. 
First, the move might be made to an excess-piene which 
does not presently yield a terminal forcing sequence by form- 
ing a new 2-O file without making a 3-0 file. When possible 
the move should be made at the intersection of two or more 
excess<-planes so that the resulting eheeat will be more 
Boniasvic and better disguised, The second possibility is 
to form a 2-0 file in the cube while moving into a plane in 
which the opponent enjoys an occupied cell excess. A 
defensive move of this type might be advisable in a game in 
which the opponent is known to be ' strong player and has the 
advantage of moving first. 

The relationship between offense and defense is clearly 
evident on the flow — If a win is not immediately avail- 
able, a check must be made on the corresponding chances of 
the sepedeit: Should neither player have a 3-0 file available, 
an offensive check is made for a terminal forcing paaienee: 
If none is found to be available, a defensive check is made 
checking the opponents possibilities. If no terminal forcing 
sequence is found on either the offense of defense, a 


"building move is made as described in the previous paragraph. 


Figure 8.1: General Move Strategy Flow Chart 
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9, COMPUTER APPLICATION AND KESULTS 


After an initial period of debugging, a PDP-4/340 D 
Computer-Display combination was programmed in MIDAS 4 
Assembly Language to play three dimensional tic-tac-toe 
on an elementary level. The machine's capability is limited 
to the strategy shown in the flow chart in Figure 4.1. 

While this appears to be quite a strong limitation in 

view of the powerful terminal forcing sequence techniques 
presented, the machine has been quite successful against 
human aeaoen tie: This success is probably influenced by 
the lack of an actual three dimensional model of the cube 
for use by the opponent. A four level two-dimensional view 
(cutting the 64 cells into four disjoint 4x4 planes) is 
displayed on the 340 D unit and serves as the model. In 
addition, an isometric view of the cube showing all 64 cells 
is ficnineed. The opponent's moves are instigated by point-~ 
ing a "light pen" (photocell) attached to the display unit 
to the desired cell in the four-level viet Immediately 
upon triggering the light pen both the opponents move and 
the computer's countermove appear simultaneously. In add- 
ition, a message appears on the display to explain why the 
computer made the move it did (i.e. blocked a miatea pair, 
etc.) As the flow chart shows, the computer makes a "preset" 
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move when no threat of a win or related pair exists on either 
offense or eteiees, The preset move is the first vacant cell 
found on a list of the 64 cells randomly ordered for each 
game. 

Attempts by opponents to obtain suitable positioning 
for terminal forcing sequences are quite often thwarted © 
by unintentionally "good" preset ee Also, in a zest to 
fortify their own offensive position and in deference to 
the random quality of the machine's moves, many opponents 
disregard defense. These factors have enabled the computer 
to build up a large winning margin, probably exceeding a5%. 
This statistic is even more impressive as the computer | 
always moves ieee, Furthermore, the computer rarely loses 
on its first play against a particular eecoueut: its 
infrequent losses usually occur only after the opponent 
realizes the limitations of the program and sets his strat- 
egy accordingly. Against novice opponents the computer 
rarely requires more than sixteen moves (thirty-two occupied 
cells) to complete a in. The state of the play is suffic- 
iently complex at this point for many players to fail to 
recognize a related pete Naturally, the computer's logic 
mechanisms are not effected by the complexity of the cubic 


configuration (other than in move time required - which is 
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nearly negligible in the related pair strategy). 

A more sophisticated program has been written in ALGOL 
60 to play using some of the techniques discussed in the 
section on planar strategy. The computer used in this 
instance is the Univac 1107. This machine has not been 
pitted against human opposition due to the input-output 
complexities inherent in the available a beat, A complete 
play of the game cout require a tie-up of the computer for 
an excessive period of time. Thus, as an alternative, the 
computer has been programmed to play against itself, using 
the same strategies in each instance, An entire play of 
the game, start to finish, usually takes less than one min- 
ute. Briefly, the capabilities of the program include: 

a, Elementary strategy - as used by the PDP-4 program, 

>. Planar strategy - including both excess~two and 

excess-three (or more terminal forcing sequences with 

XWATCH and OWATCH ovicione:. Not including pseudo 

terminal forcing sequences, 

c, Building strategy - building excess-two planes into 

excess-three planes which are possible threats as TFS. 

As in the PDF-4 program, the opening moves are made from 
a preset move list, Many complete plays have been analyzed 


and the results are quite interesting. A minimum of two moves 
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from the preset move list is made by each player at the 
opening of the eon if the moves form a 2-0 plane, the 
building strategy takes over from there, If not, a few 
additional preset moves might be necessary. No instance 
has been encountered in which either player opened with more 
than four preset aes "Strong" opening combinations 
Cee re complying to conditions specified in the last 
section) by the first player almost invariably lead to a 
din. Even "weak" opening combinations by the first player 
vield a high winning percentage, the wins usually resulting 
from correspondingly "weak" openings by the second player. 
As might be expected, strong openings by the second player 
in reply to weak openings by the first player often lead 
to a win by the second player. 

A particularly interesting result of a computer versus 
computer play was the achievement of a seas, It is 
the first such occurrence the author has ever saesaat aren. 
Daly‘? states that neither he nor any of his associates 
has ever seen a legitimate tie~game and that he is not 
certain such a play is even possible. The complete play 
of this unusual game is given im Appendix III, It is quite 
fascinating to note that related pair and 3-0 files are 


being formed and blocked even as the final cube positions 
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are being filled. 

In a few instances, the computer accidentally formed 
multiple related pairs sted eendouely: A game in which 
this occurs is also shown in Appendix III, A strategy to 
locate such possibilities has not been drawn up as the time 


necessary for its execution might prove excessive, 


10. CONCLUSIONS 


A minimax procedure beccmes essential in the solution 
of a siia eltaisetion when some intermediate evaluation scheme 
is used in conjunction with limitation of depth of es 
However, in the strategies ondes consideration the Limit- 
ation of depth is Gaeceosaser taetuse of the extremely 
efficient tree-pruning heuristics used at extrapolations 
while the intermediate evaluation schemes (if they can be 
so called) used allow for single ply exploration. The 
major heuristic used for investigating win sequences is the 
technique of "forcing", A state in a terminal forcing 
sequence is one at the opponent's move ne such that one 
of the opponent's alternatives gives rise to an immediate 
win for player X while che other give rise to a future win, 
By restricting the search to looking only for sequences of 
forces one certainly throws away the possibilities of some 
very subtle maneuvers in the game Gz. stereos related 
pairs), but the sacrifice seems worthwhile in view of the 
fact that the exploration of forcing situations takes place 
along drastically pruned trees and the need for depth limit- 
ations is seeded: Nonsovers heuristics are available for 
the creation of situations in which the possibility of | 
force situations may be highly probable. 

YD as 
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Another drastic reduction occurs in the search process 
for forcing situations by limiting the search, in most 
cases, to moves made in a suitably chosen fixed plane. The 
choice of the plane is made on the basis of the bases of 
the excess of X cells over the opponent's occupied sive: 
Actual enumeration has shown that in an isolated 3-0 
ais; in 40 out of 77 cases (counting symmetrical situations 
as identical) a terminal forcing sequence is possible. 

This possibility continues even with a few of the opponents 
pieces on the Plane as long as the difference is three or 
os The trend certainly does not continue all the way 

to (ridiculously) the 9-6 ratio, but it is of benefit to. 
use the heuristic that an excess-three is worth concentrating 
on. This heuristic applied to 2-0 planes and AWATCH cells 
is also quite valuable, While developing a force on a. 
plane, the machine has to guard against the formation of 

a threat by the opponent through his defensive moves, 

These threats may consist of a 0-3 file either in the plane 
or outside it. This is one consideration which prevents the 
complete epacsnceetaen of the efforts on a lane. However, 
since these entail only one-step explorations outside the 
eilaney they do’ not introduce any exponential growth of the 


tree with the depth of search. 
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The machine has capabilities of blocking all tactics 
on the part of the opponent that the machine uses for its. : 
sniy, a addition to the depth searches, searches for 

related pairs and 3-0 files are carried out in a routine 

manner and taken advantage of as well ae bhoeksd, The 

one large failure on the part of the machine lies in its 

| inability to either Poreeee or block forces of depth 

greater than one on both so fee However, gides such aise 

have necessarily to develop in three dimensions (the plane 
case being taken care of op tiie Ciawie terminal. forcing 
sequence tactics), the Se ere probably not suffer 
from this while playing humans, When no forcing sequence 
presents itself to the machine , the strategy consists of 

_ creating a plane with an excess or thee. This may be 

“ eotisidered the only form of intermediate evaluation el 

oe the spepia. 

No other intermediate evaluation schemes being avail- 
able, the machine plays from a table of preset moves when 
none of the possibilities engendered above are available. 

Such possibilities open up in about three moves or six 

plies, Hence the fate of the entire game (when the machine 
plays itself) is determined from the first few initial 


moves. We have at present no statistics on the efficiency 


of these initial moves, nor do we have any proven efficient 
heuristic for choosing eis It is our hope that the two 

or three plies made by the human player will be conducive 

to the machine's ones only on a random basis, but in most 
games the machine will be able to capitalize on the possib- 
jlities opened up in the first few moves better than a human 
player, 

Although some of the move sequences resulting from 
computer versus computer games in the 1107 program are 
quite interesting, it is difficult to classify the strategy 
as being exceptionally "good", It is obviously inferior 
to the strategy shown in the flow chart in Figure 8.1 since 
it includes fewer heuristics. As more and more heuristics 
are added, the machine will play "better", but a trade-off 
must be considered between "goodness of play' and move time. 
The present 1107 program requires a move time of a few 
seconds or eae 

The results of the computer versus computer plays 
leave a clear indication that the first player should win 
if the play is not a fess The strategy which will insure 
this has not been found, but the planar terminal forcing 
sequence heuristic when used in conjunction with "strong" 


Opening moves comes quite close, It is inconclusive 
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whether or not a complete play of the game using minimax 
techniques would result in a draw, This will probably 
never be known for three dimensional tic-tac-toe because of 
the gigantic number of explorations involved. 

A main weakness of the game as programmed lies in the 
absence of a strategically based opening move Saauedee. 
Perhaps too much emphasis has been placed on terminal forc- 
ing sequences in lieu of this phase of the play. The 
opening move Stvstacy sould certainly be a prime place to 
devote further effort. 

it may appear that the program discussed here is 
specifically designed for three dimensional tic~tac-toe, 
However, it must be pointed out that the strategy of forcing 
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is applicable in the end-portions of many games 
great effect this strategy has on tree-pruning is worthy of 
note in the general see: It can also be pointed out that 
the general applicability of the strategically based state 


set argument in Chapter & is born out by the tic-tac-toe 


terminal forcing sequence conditions in Chapter 5. 


APPENDIX I: A PROCEDURE FOR DETERMINING RELATED PAIRS 


The recognition of a related pair can be achieved by a 
simple heuristic which may be used by man and machine alike. 
To describe this heuristic properly, let us make several pre- 
liminary definitions. A "file set" is the group of files 
which passes through any given cell, The cell that the file 
set passed through is the "file set basis". A related pair 
can be described as two 2-0 files (or 0-2 files) in the same 
file set having a vacant file set basis. The file set basis 
in this case is referred to as a "major cell', and can be 
designated as "offensive" when the files are 2-0 and 
"defensive" when the files are o-2. 

It is clear that any of the 64 cells may serve as ma jor 
cells and that any individual vertice or core cell has a 
comparatively greater probability (7 to 4) of being a major 
cell than do other cells. | 

Three possible heuristic methods for Finding related pair 
may be stated as follows: 

7 Check the file sets associated with all occupied X 

cells. If any of the files in one of these file sets is 

found to be a e-0 file, record the vacant cells in that 

file. If one of the recorded cells appears again as a 


vacant cell in another e-0 file, it is a major cell. 


. Soest 


Repeat the test for all occupied | Y cells and corresronding 
(0+2 files, . 
2, Check the file ee aeaceiated With all. vacant cells. 
| If two (ee more ) of the files in a File set sentain 2-0 
files or 0-2 pracee the file set basis is a major ée12 
| 3. Check the 16 files for 2-0 files. If any are found, 
record the eaent cells in those files. If any cell is 
Seesnied twice it is a major cell, 
Although each of nee procedures fey be useful in the 
course of a game , procedure (3) is the best room both as 
and relative efficiency standpoints. Procedure Q is an 
excellent one to follow in the first several moves of the 
play since it is ; only concerned with occupied cells. How- | 
ever, much of its usefulness is dasted by virtue of tis fact 
that a ‘related pair caano® be formed until one peer has 
made at least four moves, pce a ne manner , procedure (2) 
can be cae in a play in which few vacant cells remain 
9 on the board, Such a pee quite rare in reality. Appli- 
cation of procedure (3) requires only 76 file checks regard- 
less of ‘the nunber of moves on the board. The asiie. con- 
tained in each of the 76 ise: are listed in Table Ts and 
the file sets for ony given file met nae are given in 


Table II, The information contained in Tables I and II, 
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when used for the purpose of applying the "related pair 
strategy" is sufficient to yield a non-trivial play of the 
game, This fact has been verified by the performance of 


the PDP-4 computer against human opposition, 
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Table I: Cells Contained in Each File 
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Table IIs File Sets Corresponding to Each Major Cell 


APPENDIX II: TERMINAL FORCING SEQUENCES IN ISOLATED 
- 3-0 PLANES 

As the terminal forcing sequence has — set forth as 
hie, Matronssste strategy available in a given plane of the 
cube , its earliest occurance is worthy of pest ieaeion, 
This situation in which reasonable doubt in first encountered 
with respect to terminal forcing sequences is in the 3-0 
aise: (Recall that 1804 of the 1820 4-0 planar configur- 
ations lead to pseudo-terminal feneine avquaiesd) Of the 
560 different configurations arising from three occupied 
cells in a set of 16, 77 can be shown to be independent 
after ssunp ty conasestione: The 77 configurations consist 
| of 63 having eight symmetries and fourteen having four 
seamstvies. The symmetries consist of two ‘diagonal flips" 
for each of four 90° eottiene: An example of the eight 
symmetries for a simple four on plane is shown in 
Figure II.1. The 90° rotations are shown in ad and the 
"diagonal flips't for each of these rotations in e-h, 
penser, Those 5-0 planes which have only four 
symmetries are es ence which are symmetrical about a 
Aiweonst, 

A program written in ALGOL 60 for the Univac 1107 

for generating the 77 3-O planes is shown at the end 


of this appendix. A simplified flow chart of the 
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Table III: List of the 77 3-0 Planes 
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Table IV: Summary of Table III 
Number of fotal No. of} Number of 
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program is shown in Figure II,2. In addition, a pro- 

gram is given for generating the different haste 40 
anes: The "transformation" operations the programs 

refer to are the rotations and flips used to obtain the 
 @ight planar symmetries. | 

The cell configurations of the 77 3-0 planes are listed 
in Table III (with cells numbered as in Figure 5.2). Also 
| the number of 2-0 files in the plane and the existance or 
absence of a terminal forcing sequence are soe sieiou: When 
a terminal forcing sequence exists, all possible opening 
moves: asadine to the win are given, An asterisk indicates 
that a pseudo-terminal forcing sequen: is known to arise... 
As no exhaust search has been made for pseudo forces, this 
list is by no means complete in this respect. 

A summary of the information presented in Table III is 
shown in Table Iv. From Table IV it can be seen that all 
3-0 planes having three 2-0 files eee terminal 
forcing re As the number of initial 2-0 files 
decreases, the probability of a terminal forcing sequence 
in the eight-symmetry planes lessens. In the four- 
symmetry planes, however, all. planes which initially 


contain either one or three 2-0 yield 


bn, SOP ge 


a force while those which contain zero or two ¢<-0 
files do not, This result is most unusual. 

While the information in Table 4 was not utilized 
by the existing computer program, it gives rise to 
further heuristics which may prove to be reliable. 
ee, All four-symmetry 3-O planes having only one 


2-0 file lead to a terminal forcing sequence.) 


| Declaration of 
integers and arrays 


iGenerate all 560 com= 
|binations of three 
(calls in a plane 


Make symmetry trans- 
formation and eliminate 
those combination of 
the original 560 which | 
have been formed by 
the transfbrmation 


Have seven transform- 
lations been made? 
| ag 


List all remaining 
combinations 


Figure I1.2, Flow Chart of ALGOL Program for 3-0 Planes 


ALG PROBI . 
ALGOL MARCH 10+¢1965 © ; INTERFACE FFBRUARY 1591965 - PASS2 DECEMBER 23, 19564 


1 COMMENT THIS PROGRAM TS DESIGNED TO-FIND ALL THE POSSTBLE WAYS. 
2 AFTER SYMMETRY CONSIDERATIONS THAT THREE OCCUPIED CELLS CAN RE 
3 PLACEN IN A PLANE OF SIXTEEN CELLS.S 
4 INTEGER LeJUeKeQeZeRS 
BLOCK 1 LEVEL 1 Bn 


5 INTEGER ARRAY ArBoCoEoFeGl1ee560) eMZeMAoMSeMCoMDoMEoME (0-216) 
6 SWITCH L=oLArLReLCeLDeLEeLF ol Gs 
7 READ (MZsMAeMBRo MC oMDeo ME eo MP) S 

8 wWRITECP*FIRST TRANSFORMATIONS 0 M7) 

9 WRITE(*SECOND TRANSFORMATION® + MAIS 


10 WRITE(*THIRD TRANSFORMATION' eMA)S 
11 WalTE(*FOURTH TRANSFORMATIONS #MC)S 

12 WRITECTEIFTH TRANSFORMATION' eMn)S 

13 . waITE(*SIXTH TRANSFORMATION! »MF)S 

14 waIlTE(*SEVENTH TRANSFORMATION! »MF)S 

15 FOR I-(1°1°14) DO BEGIN FOR J=(2e1*15) DO REGIN FOR K=(391e1l0) NO BEGIN B1 R2 

16 iF I LSS J ANN J LSS K THEN BEGIN Q@=Q415 A(Q)=1S 8(Q)=US C(9)=K END END B3 54 Eu E3 
17 ENN ENDS FO El 

18 FOR 12(101°560) DO BEGIN ECI)=MZ(A(T) SF (1) =MZ(B(T) 3601) =2MZ(C(T)) BS 

19 ENDS GO TON RSS | _ 

20 LAeeENR I=(1e1*560) DO BEGIN FCI) =MA(ACT)) SF (1) =MA(B(T))SG(1) SMA(C(T)) BE 

21 ENDS GO TO R5S EF 

22 LBeeFOR i=(1019560) DO BEGIN FCIY=MB(ACT)) SF (1) =MB(B( 1) )SG(T)=MB(C(T)) B7 

23 ENDS GO TN R5% a E7 

24 LCeeFOR I=(1°1°560) DO REGIN EC(I)=MC(ACT))SF(T) =MC(B(T))S6¢IT)=MC(C(T)) BR 

25 ENDS GO TO R5S io ER 

26 LDeeFOR 12(191°500) DO BEGIN ECI)=MD( ACT) SFC IT) =MN(B(T) S6(TI=MN(C(T)) 49 

27 ENDS GO TO RSS : | EO 

28 LE.sFOR Tr(1e1?560) DO BEGIN FCI) =ME(A(T) SF (CT) =ME(B(T) S601) =ME(C(T)) B10 

29 ENDS GO TO R5S oe | E10 

30 LFeeFOR I=(101°560) DO BEGIN EC(I)=MF (A(T) ) SF CT) SMF (BT) S601) =MF (C(I) ) Bil 

31 ENDS GO TO R5% : E11 

32 LGee GO TO VERYS 

33 R5eeFOR Ir(191*560) DO REGIN 

34 IE ECL) GTR F(T) THEN BEGIN R=E(T)S ECI)SFCI)$ FCL)=ER ENDS | B12. B13 «£13 
35 IF F(i) GTR G(T) THEN 3EGIN REF(I)S& F(T) 2G(1)% GCI)=R ENDS B14 €14 

36 IF ECL) 6TR F(T) THEN BEGIN REE(IT)@ ECI)=F(I)S FCI)=ER END ENDS B15 £15 £12 
37 GO To R0$ | 

38 RO-e--1=05 

39 Rleelzl+15 IF I EOL 561 THEN GO TO R6$ J=05 

40 IF E(1) EQt 0 THEN GO TO RIS 

41 R2eeJzut+1$ IF J EOL 561 THEN GO TO R1S 

42 TE ECL) FQL ACJ) AND F(T) FQ@L BU) AND GCI) EGL Clu) THEN 8EGIN 

43 AC j)2us 3(9)208 C(U)=0S E(y)=05 F(Y)=0S G(YI=0% GO TO R1 ENDS . H16 £16 

4y GO TO R2s 7 


45 R605<e 7=2+15 GO TO L(2)$ 


46 VERYe. 7 ; 
_ &7 | WRITEC*LISTING OF ALL 3 IN A SQUARE POSSIBILITIES) S 
4B I=NS e708 . 
49 RBeel=14+15 IF I EQL 561 THEN GO TO VFRY25 
50 _ Ie Ai) EQL ON THEN GO TO RAS QO=Qt15 
51 WRITE(QOACTI eC BI) e C(I) 3S) 
52 GO TO RBS 
53 VERY2.ceFINISH 
END BtOCK 1 : 
COMPILATION COMPLETED 
FIRST TRANSFORMATION 
0 4 8 lp 16 3 
6 10 14 i 5 Q 
SECOND TRANSFORMATION 
0 16° 15 14 13 12 
7 6 5 u 3 ? 
THIRD TRANSFORMATION 
0 13 9 5 1 iu 
11 7 3 16 12 R 
FOURTH TRANSFORMATION : 
0 1 5 9 13 ? 
7 ii 15 u 8 1? 
FIFTH TRANSFORMATION 
0 4 3 ? 1 A 
ee il - 10 9 16 i5 14 
SIxTH TRANSFORMATION . 
0 16 12 R 4 15 
. 10 6 2 i3 9 5 
SEVENTH TRANSFORMATION 
0 13 14 15 16 9 
6. 7 8 1 2 % 


1) 


19 


19 


11 


15 


14 


in 


12 


15 


14& 


~ 68 = 


MONITOR SYSTEM <-- 65X84 03/11/65 
R CITRENBAUM 


RUN 


ALG .PROB2 
AL GOL 


BLOCK 1 


OD IH FUN & 


MARCH 101965. 
COMMENT THIS PROGRAM TS DESIGNED TO FIND ALL THE POSSTBLE WAYS 


. AFTER SYMMETRY CONSIDERATIONS THAT FOUR OCCUPTED CELLS CAN RE 
PLACED IN A PLANE OF SIXTEEN CELLS.S 
INTEGER TedeKeQeZeRS 


LEVEL 1 


TIME: 


INTERFACE FFBRUARY 15-1965 PASS2 DECEM3ER 23, 


INTEGER ARRAY AeBeCoDeE oF eGeH( 1.01820) oMZ»MArMBoMC oMDe ME eMF(0.016)$ 
SWITCH LoLArLAeLCoLDeLEeL Fel Gs 

READ (MZeMAeMReMUCeMDeME oe ME) S 

WRITEC*FIRST TRANSFORMATION’ #M7)S 

WRITE (C*SECOND TRANSFORMATION! » MAIS 

WRITE (* THIRD TRANSFORMATION! oe MRIS 

WRITEL*FOURTH TRANSFORMATION! » MCS 

WRITECOFIFTH TRANSFORMATION oMD)S 

wRITEC*SIXTH TRANSFORMATION #ME DS 

weITE(*SEVENTH TRANSFORMATION! »MF)S 

FOR Ir(tei1*13) DO BEGIN FOR JU=l2riel&) DO REGIN FOR K2=(3-e1015) DO BEGIN 


FOR R=(491°16) DO BEGIN 


IF I LSS J AND J LSS K AND K LSS R 


ENN END ENO END ENDS 


% 


FAR Iz(1e1°00) 00 
H(1)=Mz(Dll)) 
ENDS GO TO R5$ 


LAceFOR I=(191°6) = DO 


$ 


HCIDSMA(D(I)) 
ENDS GO TO R5% 


LBeoFOR I=(1°109) DO 


5 


H(T) MB (D(1)) 
ENDS GO TO RSS 


LCeeFOR F=(1el*Q) DO 


% 


H(I)=MCCOCT)? 
ENDS GO TO R5S 


LDe FOR T=(101+0) DO 


$ 


H(T)=Mo(o(1)) 


-ENDS GO TO RSS 


LE. eFOR T=(1+e1"0) DO 


$ 


H(IT)=MeE(O(1I)) 
ENDS GO TO RSS 


LFeeFOR T=(19°19°0) DO 


$ 


H(IT) ome (D(1)) 
ENDS GO TO RSS 


LGee GO TO VERYS 
R56eFOR I=C101¢Q) DO 


TF ECT) GTR FCT) 
IF FCI) GTR GtI) 


THEN BEGIN G=Q41S A(Q)=IS B(Q)2US C(O) =KSD(Q)I=R 
BEGIN ia cuivatsioee er eeccmaeciiazieins 
BEGIN ECL) SMACACD) SCL) EMACBCT) 156(1)=MACCCDD) 
REGIN £(T)=MB(A(T))SF(T)=M8(B( 7) $6 (T)=MB(C(T)) 
BEGIN E(T)=MC(A(T)) SF (T)=MC(B(T) )SGCT)EMCEC(T) ): 
BEGIN EC I)=MD(A(T) SFT) =M9(B(T) SGC TI=MD(C(T)) 
BEGIN E(I)SME(ACT))SFCT) 2ME(B(T) SG( 1) =ME(C(T)) 


BEGIN F.CI)SMFCACTIISFITI= ME (BCT) SGC IT) =ME(C(T)) 


BEGIN 


THEN SEGIN R=E(T)S ECTI=F(I)S FCIYER ENDS 
THEN 83EGIN R=F(IOS FCTI=SG(I)$ GCI)=R ENDS 


10245214 


1964 


BO 


B1 
B3 
Bu 


BS 


ES 
a 


Bb 


E6 
B87 


E7 
BR 


-ER 
‘Bg 


ES 
B10 


a 
Bil 


Ell 
B12 


E12 


B13 
B15 


B2 


EY 


R14 
E15 


MATES 


E3 


£14 


15 MAR 65 


£2 


67 
68 
END BLOCK 1 


wh 
Ge 


IF G(T) GTR H(T) THEN 3EG1N R=G(1)$ G(T) =H(1)s HC(T)ER 
IF E(1) GTR FCI) THEN SEGIN RIE(T)& ECIISF(I)S FCI)SR 
IF F(L) GTR G(T) THEN BEGIN R=F(I)$ FCII=HG(I)S GCI)ESR. 
IF GCI) GTR H(I) THEN BEGIN R=G(I)S GIY)SH(I)S HCI)SR 
IF E( I) GTR FCI) THEN BEGIN R=E(T)S ECT =F(I)S FCI)D=R 
GO To ROS 

RO. -1=05 


Rie els=I+15 IF I EQL 1821 THEN GO TO R&S J=0S 
IF E€(1) FQL O THEN GO TO R1$ 
R2eeJtUtiS IF J EQL 1821 THEN GO TO R1$ 
IF ECy) FAL ACY) AND FCI) FOL BCU) AND GCI) Eot Cly) 
AND H(1) EQL DCU) THEN REGIN 
O(Ud=0s HU) =0S 
ACy)sus 8¢(U) 20S ClyU=t0S El(ys0s F(Yy)20S GlYU)=0S GO TO 
GO TO R2$ 
Ree 2=Z+1S GO TO L(Z)$ 
VERYe. 


ENDS 
ENOS 
ENDS 
ENDS 
END ENDS 


Rl ENDS 


WRITEC* LISTING OF ALL 4 IN A SQUARE POSSIBILITIES") $ 


T=0% Q=0$ . 
RBeeI=14+15 IF I EQL 1821 THEN GO TO VERY2S 
IF ACI) EFQL O THEN GO TO RRS Q=Q415 

WRITE(QOACTI PBI I) eC(T) eD(I) IS 
GO TO RBS 
VERY2.eFINISH : 


COMPILATION COMPLETED 


FIRST TRANSFORMATION 


0 4 8 1? 16 5 
6 10 14 1 5 9 
SECOND TRANSFORMATION 
. 0 16 15 14 13 12 
, oF 6 5 3 ? 
THIRD TRANSFORMATION 
“0 13 9 5 1 14 
il 7 3 16 12 a 
FOURTH TRANSFORMATION 
0 1 5 9 15 2 
; 7 il Lo 4 8 1? 
FIFTH TRANSFORMATION 
0 4 3 1 R 
11 10 9 16 15 iv 
SIXTH TRANSFORMATION 
0 14 12 8 4 15 
10 6 2 13 9 5 
SEVENTH TRANSFORMATION 
0 13 14 15 16 cy 
6 7 8 2 3 


11 


in 


10 


li 


B16 
B17 


B18 
B19 
B20 


Bal 
Et 


FQ 


15 


14 


12 


£16 
E17 


£18 
E19 
£20 


E13 


15 


12 


14 


wont T6 _ 


APPENDIX III: INTERESTING COMPUTER VERSUS COMPUTER PLAYS 


This appendix contains three complete computer 


versus computer plays obtained by the 1107 program. 


The plays chosen include: 


1. A tie~game. 


&. A win by the first player (xX) resulting from 


the simultaneous formation of two independent 


related pairs. 


3. A win by the second player (0). | 


These three plays are shown in Figures III.1 a,b,c 


respectively. (The views shown in Figure III.1 


correspond to the four level model of the cube shown 


in Figure 3.2.) The reason behind each computer move 


in these plays (as printed out by the computer itself) 


is listed below: 


Game One (Figure III.1la) 


xX: Preset move 


X,3 Preset move 
x. ¢ Preset move 
Xx: Forms an excess- 


three plane 


X_: Forms an excess= 
three plane 


Preset move 


Preset move 
Preset move 
Blocks a TFS 


Forms an excess~ 
three plane 


be 


Blocks a TFS 


Forms an excess~ 
three plane 


Forms an excess= 
three plane 


Blocks a TFS 


Blocks a related 


pair 
Blocks a TFS 
Preset move 


Blocks a 0-3 


file 


Blocks 


Blocks 
pair 


a related 


Blocks 


Blocks 
Blocks 


Moves to XWATCH 
cells in excess- 
two plane 


Forms an excess- 
four plane 


Blocks a related 
pair | 


a O-3 file 


a O-3 file 


a O-3 file 


a O-3 file 


= 93 


0. ¢ HKorms an excess- 
three plane 

0. ¢ Blocks a related 
pair 

0, : Blocks a related 
pair 

04 : Blocks a 3-0 file 

003 Forms an excess- 
three plane 

0,5: Blocks a TFS 

05 93 Preset move 

0153 Moves to OWATCH cell 
in excess-two plane 

O.,: Forms an excess- 

14 | | 

four plane 

0,53 Forms an excess- 
three plane 

016? Blocks a 3-0 file 

Oj 0% Blocks a related 

| pair 

QO; 9: Blocks a related 
pair 

0593 Blocks a 3-0 Pile | 

O55? Blocks a related 
pair 

05,3 Preset move 


Moves to OWATCH 
cell in excess-= 
three plane 


Moves to OWATCH 
cell in excess- 
three plane | 


Forms an excess- 
four plane 


Forms an excess= _ 


four plane 
Preset move 


Blocks related 
pair 


Preset move 
Preset move 
Preset move 


Blocks O-3 file 


¢ Preset move 


O503 Blocks 
On, : Blocks 
O54! Blocks 
Oor% Preset 
Qog? Preset 
0,7? Preset 
059% Preset 
| — 9593 Preset 
Oz? Preset 
On? Blocks 
0,53 Preset 


All board positions being occupied , the 


declared a tie. 


+e 


oe 


Game Two (Figure III,1b) 


Preset move 
Preset move 


Preset move 


Forms an excess= | 


three plane 


Preset 


Preset 


Preset 


Blocks 


a O-3 file 
a O-3 file © 


a O=-3 file 
move - 


move = 


move 


move 
move 
move — 
5-0 file 


move 


game is 


MmOoVe | 


move 


move - 


a TFS 


Ps 


Moves to XWATCH 
cell in excess- 
two plane 


Blocks a O-%3 file 


Forms an excess~ 
three plane 


Blocks a TFS 


Blocks a TFS 


Blocks a TES 


Blocks 0-3 file 


Moves to XWATCH 
cell in excess- 


two plane 


Blocks a TFS 


Blocks a related 
pair 


Blocks a 0-3 file 


Blocks a related 
pair 


: Blocks a 0-3 file 


Forms two 3-0 files. 


Forms a 4-0 file, 
wins 


~ 95 


ee CT rT ee 


Blocks a 3-0 file 


Blocks a TFS 


Blocks a TFS 


Forms an excess-= 


three plane 
Blocks a TFS 


Moves to OWATCH 
cell in excess- 


two plane 


Blocks related pair 


Blocks 3-0 file 


Forms excess= 
three plane 


Moves to OWATCH 


cell in excess- 
two plane 


Forms an excess= 
four plane 


Blocks a 3-0 file | 


Blocks a related 
pair 


Blocks a 3-0 file, 
concedes 


Pi PS 


Ps 


P 


P< 


ss 
2a 


-96 = 


_ Game Three (Figure III,1c) 


Preset move 


Preset move 


Forms 
three 


Forms 
three 


Forms 
three 


Forms 
three 


an @xcess~. 


plane 


an excess- 
plane 


an excess- 


plane 


an excess- 
plane 


Starts a TFS 


Continues TFS 


Continues TFS 


Forms 
files 


Forms a 4-0 file, 


wins 


two 3-0 


QO. 3: 


On. ¢ 


© ©: © 
oe Ty ee 


© 


~j 
eo 


Preset move. 


Preset move 


Blocks 


Blocks 


- Blocks 


Blocks 


Blocks 
Blocks 
Blocks 


Blocks 


a TFS 
a TFS 
a TFS 
a TFS 


a 3-0 file 
a 3-0 file 
a 3-0 file 


a 3-0 file, 


concedes 


= OF = 


Figure III,1 


APPENDIX IV: PDP-4 PROGRAM © 


By virtue of a program similar to the one given 
in this appendix, the PDP-4 nee plays against 
unan Gpmnante: The game is played on the 540 dis~ 
play unit which works in conjunction with the PDP=4, 
Desired figures are programmed to appear on the 340 D 
using the ie available points of Light on the CRI, 

a square of side 9 1/4 Gachaas These figures include: 

1. Four level two dimensional view of cube 

(four 4x4 sane) 

&. Message giving reason for preceding computer 

move 

5, Isometric view of the cube 

é Clockface timing each opponent move one) 

The opponent's moves are read into the computer | 
by either of two means : 

1, Pressing the awenouriate buttons on the 

console 

2, Pointing light pen (photocell) at desired 

cell on four level ek 

When an opponent's move is read into the computer, 
a decision is made as to the proper countermove and 


both the move and countermove are displayed on the 


= OG -« 


a: «(nit al 


= OO° w= 


four level view and isometric view. At ths same 
time, the message on the screen changes from its. 
former state to describe the reason for the computer's 
ete The clock resets itself to zero and begins 
ticking sag in real time waiting for the opponent's 
next ss (The clock has hour, minute, and second 
hands which update themselves once each second by 
ee of an internal counter in the computer. The 
counter is accurate to 1/60 second.) 

When a win by either the computer or the opponent 
occurs, a line is drawn through the apprepriate four 
cells in the isometric view. 


Due to the length of the original program written 


in MIDAS 4 Assembly Language for the PDP-4 an AIGOL 


60 program using the same related pair strategy is 
substituted oo The novel characteristics of the 
MIDAS 4 program are not included in the anon version: 
As an aid to understanding the eee: a flow 
chart is given in Figure IV.1, and definitions of the 
integers and arrays used in the program are given in 
Appendix v The data for the three arrays used 
(FILENOS, FILECELLS, and PIABIE) is the same as that 


for the program in Appendix V and is included after 


that program, 


= Od 
Figure IV,1: Flow Chart of ALGOL Program for Related 
Pair Strategy 


Declaration of 
integers f arrays| 


Lists. 


— POSITO and | 
OF ILE lists; index | 
| COMPNOV” 


Write: Two 3-0 
files have been. 
found simultan- fF 


Writes Blocked a] 
related pair 


MONITOR SYSTEM -= 65K84 03711765 


RUN R CITRENBAUY : . TIMES 10344339 
ALG PROBL 
ALGOL MARCH 1021965 INTERFACE FFBRUARY 1591965 PASS2 DECEMSER 234 1964 
1 COMMENT THIS PROGRAM TS DESIGNED TO PLAY THREE DIMENSTONAL TIC-TAC TOE 
.2 USING THE RELATED PAIR STRATEGY. | 
3 ALL MOVES MADE BY THE OPPONENT MUST BE SPECIFIFD REFORE THE 
4 GAME BEGINS.-$ 
5 INTEGER DUM I» OPPMOV + NUMX » COMPMOV + NUMN# DELTA, Je Ks MS 
BLOCK 1 LEVEL 1 Bn 
6 INTEGER ARRAY FILENOS (1.0448) > 
7 FILECELLS (10.308) » PTABLE(1..64) 6 NEWMOVE(1.¢20)» 
B POSITO*POSITX(1.632)0 CTARLE(1..60)9 QTABLE(1.230)5 
9 OFILEs XFILE(0+.76)+ TABIO*eTABNI1(1..50), TAR20» 
10 TABO2(1.¢15) + TAB30e TAROS(1..4)6 LOOP(1-.6)$ 
i1 SWITCH La=LAUe LAL» LA2e LASS : ; 
12. SWITCH LA=LADeLB1leLB2rLB5eL BG 
13 READ ( FILENOS*s FILECELLS» PTABLE, NEWMOVE)$ 
14 WRITE (*COMPLETE LISTING OF DATA= ENECUOENG INFORMATION In THE LISTS.1)8 
15 WRITE (C*FILENOS LIST »sFILENOS)S 
16 WRITE (°FILECELLS LIST*sFILECELLS)S 
17 WRITE (*PTASLE LIST*+PTABLE)S 
18 NEXTMONVE.eFOR I=(191¢60) DO CrABLE(T)= Os 
19 FOR I=(101¢30) DO OTABLE(I)=05 
20 FOR I=(191°50) DO BEGIN TABIN(II=05 tARDLTT=ZO ‘ENDS Bi El 
21 FOR T2(ieile915) DO BEGIN TAB20(1)=05 TARD2(1)=0 ENDS B? £2 
22 FOR I=(1eieu ) NO BEGIN TABZOCII=0$ TABOS(II=0 ENDS , B3 E3 
23 OPPMOVSOPPMOVELS 
24 NUMX=NEWMOVE (OPPMOV)S 
25 WRITE (*THE OPPONENT HAS MOVED TO CELL ' »NUMX)S 
26 — POSTTX (COPPMOV) =NUMXS 
27 DELTA=( 7*®NUMX ) -65 
28 FOR K=(1¢01°7) 00 | 
29 BEGIN M=FILENOS(NELTAIS au 
38 XFILE(M) SXF ILE (mM) 415 an 
31 DELTA=DEL TAt+i ENNS : a €u 
32 Te OPPMOV GTR 1 THEN _ * 
33 BEGIN COMPMOV=OPPMOV$-15 BS 
34 POSITO(COMPMOV) =NUMOS a 
35 DELTA=(7*NUMO0) -65 
36 FOR K={iels7) 09 , a. 
37 BEGIN M=FILENOS(DELTA)S ; Be 
38 OFILE(M)SOFILE (4) 415) ; 
39 DELTA=DELTA+1 END ENDS © Es ES 
40 IF OPPMOV LSS 3 THEN GO TO PRESETS ; 
41 FOR IJ=(12106) 00 LOOP(I)=05 
42 FOR I=(191°76) 90 | - 
43 BEGIN IF XFILE(T) Eoal O THEN -B7 
44 BEGIN DUM=OFILE(I)415 BR 
4s 


60 TO LA(DUmM) END ELSE ER 


NATE: 15 MAR 65 


# GOL 


IF OF 


I EOL 
BEGIN 


) THEN 
Uns tea bats t 
60 TO LBC(0UM) ENDS 


LE(I 
Dum 


LAQee8O TO ALLS 


LA1. -L00P (1) =LO00P(19415 


~ KSL 0090105 
TABLOCKI=I§$ 
60 TO ALLS 
LASe eL 00P(23=L00P(2)415 
K=~L00P(9)$ 
TAB20(KISIS 
RO TO ALLS 


LAS eeL 00P(3)9SL00P (3) 418 


K2L00P(3)5 
TAS3SO(KI=RIS 
60 10 ALLS 
B16 -LONP(4)=LO00P (4) 415 
: K2L009(4)$ 
TAROL(KISTIS 
G0 TO ALLS 


LB2-eL00P(5) SL 00P(5) +418 


K=L00°(5)$ 
TABN2(KI=EITS 
60 TO ALLS 
L83--L008(6)SL00P (6) +15 
: K=ZLO00> (A$ 
TARNS(KISTS 
GO TO ALLS 
LBU.eWRITE(* THE COMPUTER HAS LosT.* Ss 
WRITE(C* THE OPPONENT HAS FOUR IN A ROW IN FILE’, I}s 
60 TO VERYS 
ALL» eM=1 END FORLOOPS 
If LOOP(3} GTR A THEN Go TO MAKFHOS 
IF LOOP(6) GTR. THEN GO TO BLOCKO3$ 
IF LOOP(2) GTR 1 THEN GO TO TEST205 
IF LOOP(S) GTR 1 THEN GO TO TESTO2 ELSE GO TO PRESETS 
MAKE RNs eNELTAS(44TAB3N(1) )-35 
FOR J=(LeleG) OO BEGIN CTABLE(I)SFILECELLS(DELTA)S 
DELTASDELTAt1 ENN FORLOOPS 
J=08 
BACK2, eUSJ415 12508 


BACK1,eI=I¢1$ 


IF POSITO(I) Eal 0 THEN GO TO wIN ELSE 
IF POSITO(IT) EQL CTABLE(J) THEN GO TO RACK2 
ELSE GO TO BACKI$ 
WINseWRITE(*THE COMPUTER HAS WON AS IT HAS MADE FOUR')S 
WRITEC*IN A ROW BY MOVING TO CELL * sCTARLE(J))S 
GO TO VERYS | 
BLOCKNS..IF LOOP(6) GTR 1 THEN 


BEGIN WRITE(*THE COMPUTER CONCENES THE GAME. IT HOPES THE')$S 
WRITE( OPPONENT WILL GIVE IT AN OPPORTUNITY TO PLAY')S 


WRITE(* AGAIN')S 
60 TO BLOCKA ENDS 
BLOCK A. «DELTA=(4*TABU3(1)) =35 


B9 
ES 


€7 
B10 


E10 


Bil 


E1l 


-~ SOT - 


100 


101 | 


102 
103 
104 


105 _ 


106 
107 
108 
109 
110 
111 
i112 
113 
114 
115 
116 
117 
118 
119 
120 
121 
122 


123. 


124 
‘125 
126 
127 
128 
129 
130 
131 
132 
133 
134 
135 
136 
137 
138 
139 
140 


141 


142 
143 
144 
145 
146 
147 
148 
149 
150 
151 
152 
153 


FOR T=(lele4) DO BEGIN CTABLE (T)=FILECELLS(DELTAIS 
OELTASOELTA+L ENDS 
J=05 
RACKU, sJSJt1$ 1505 


BACKS. e[=1T+15 


IE POSITX(I) EQL 0 THEN GO TO RALOCKR ELSE 
IF POSITX(T) EQL CTABLE(J) THEN 60 TO BACK4& ELSE GO To BACK3$S 
BLOCKR. .NUMO=CTABLE(U)S 
WRITE(*THE COMPUTER HAS BLOCKED A THREE IN A ROW *)$ 
WRITE(* BY MOVING TO CELL* + NUIMO)S 
_ GO TO NEXTMOVES ; 
TEST2H¢- -1=OSK=0$ 
BACKS. eISI+is 
IF I LEQ LOOP(2) THEN 
REGIN DELTA= =(4*TAB20(1))—-3S FOR y=liveles4) DO 
BEGIN M=JU+KS$ CTABLE(M)=FILECELLS(DELTA)S © 
ss DELTASDELTA+1 END FORLOOPS 
K=K4+4$ 
GO TO BACKS END 
FLSE GO TO BIRDS 
BIRD-e.UTUS K=15— 
BACK6. eJaJt15S 1505 
, IF CTARLE (J) EOL O THEN GO TO COLTS 
BACK7. eT=It+1$ ; 
IF POSITO(I). EQL 0 THEN 
BEGIN GTABLE(KISCTABLE(U)S$ K=K+1$ 
60 TO BACKER ENDS 
IF POSITO(I) EQL CTABLE (J) THEN GO TO RACK6 ELSE GO ee BACK7S 
COLT..J=1% K=25 
BACKite.eIF QTABLE (YU) FQ@L OTABLE(K) THEN GO TO RELATED ELSE K=K+1$ 
IF @TARLE(K) GTR O THEN GO TO RACK11 ELSE JEJt15 K=U+15$ 
IF OTARLE(K) GTR O THEN GO TO RACK1I1 ELSE GO Tn REMAKES 
REMAKEe .FOR I=(101960) DO CTABLE(T)=0¢ 
FOR I=(1e1°30) DO QTARLE(T)=US 
IF LooPp(S) EQL 0 THEN GO TO PRESETS 
TESTO. .1=0% K=0S 
BACKS. eI=I+1S 
IF I tE@ LOOP(5) THEN 
SEGIN DELTA=(4#TABN2(1))—36 FOR J=(1eie4) 0 
BEGIN MEJ+KS , 
CTABLE(M)=FILECELLS(DELTAIS 
DELTASDELTAt+1 ENDS 
K=K4+4$ GO TO BACKB ENDS 
URIOLFe .J=08 K=1$ 


. BACKS. «J=JU+1$ I=05 


IF CTABLE(y) EQL 0 THFN GO TO BULLETS 

BACK1iNne -I=I+t1$ 
- TF POSITX(T) EQ@L O THEN BEGIN TABLE (K)=CTABLE (J) 5 
“KEK4+1$ GO TO RACKS ENDS 

IF POSITX(I) EQL CTABLE(J) THEN GO TO RACKO ELSE GO TO BACK1INS 
BULLET+.J=15 K=2% 
BACK12-.1F OTABLE(J) EQL QTABLE(K) THEN GO TO BLOCKREL ELSE K=K4+1$ 

IF QOTABLE(K) GTR O THEN GO TO RACK12 ELSE J=Jt1S K=J+1$ 

IF Q@TABLE(K) GTR O THEN GO TO BACK1i2 ELSE GO TO PRESETS 


mo 
fn fos 
wn 


B13 


B14 


E14 © 


E13 


B15 
E15 


B16 
B17 


E17 
E16 


B18 
E18 


ae 40) 


154 
155 
156 
157 
158 


~ 159 - 


160 
161 
162 
163 
164 
165 
(166 
167 
168 
169 
170 
171 
172 
173 
END BLOCK 1 


RELATED. -NUMO=QTABLE(J)$ 
WRITEC*THE COMPUTER HAS FORMEN A RELATED?!)S 


WRITEC* PAIR AND WILL WIN ON ITS NEXT MOVE.')S 
WRITE (® TT HAS JUST MOVED TO CELL * *+NUMO)S 
GO TO NEXTMOVES 
BLOCKREL e eNUMO=QTABLE (JU) 
WRITE(*THE COMPUTER HAS, BLOCKED A POSSIBLE')S 
WRITE (9 RELATED PAIR BY MOVING TO CELL*+NUMO)S 
GO TO NEXTMOVES 
PRESET-e.1=18 J=15. 
BACK1iGe.IF PTABLE(U) EQL POSITX(I) OR PTABLE(J) EQL POSITC(I) THEN 
BEGIN J=J+15 I= 1% GO TO BACK14 ENDS I=It1S 
IF I GTR OPPMOV THEN BEGIN NUMOQ=PTARLE(JU)S 
WRITE('THE COMPUTER HAS NOT BREEN FORCED TO GO')S 
WRITE(* ON THE DEFENSIVE AND HAS MOVFD TO CELL*»+NUMO)S 
6O TO NEXTMOVE ENDS GO TO BACK14$ 
VERYes WRITE(*POSITO TABLE't)S. 
FOR I=(iet»eCOMPMOV) DO WRITE (POSITO(I))S$ 
FOR I=liel»sOPPMOV ) DO WRITE (POSITX(T))S 
FINISH 


COMPILATION COMPLETED 


Bi9 
B20 


E20 


FO 


E19 


paar 0, Seite: 


APPENDIX V: 1107 FROGRAM 


The computer versus computer games have been played 
using the Univac 1107 computer programmed in ALGOL 60, 

To aid the interested reader in understanding the 
program, a list of the purposes of the integers and arrays 
contained in the program are given below. The number in 
parenthesis for each of the arrays is the number of available 
elements in that seeaie. The elements of the first eight 
arrays discussed below are given in the data section shown 


after the program, 


integer Listing 


QPPMOV Move number of the preceding move of the 
opponent 

COMPMOV Move number of the previous move of the 
machine 

NUMK Cell to which opponent made previous move 


(numbered from 1 to 64) 


NUMO . Cell to which machine made previous move 
(numbered from 1 to 64) 


GAME Play under consideration. Allows many 
plays to be done in succession 


OAVETR. Cell in TREE which is saved for later 
examination 
CNTFIL Number of 2-0 files in plane under 
| consideration 


= 106 ™ 


DEF 


FT ,CK 


PLAYER 


TRY 1, 
TRY 2 


RELPR 
FILE19 
STABP 


CNTSQ 


FORCESEQ 
COUNT 2g 


CNT ,CNT2 


= 107 = 


Switch which determines whether computer 
is observing offensive or defensive tactics 


Indices used for counting types of excess- 
two and excess-three planar situations on 
offense and defense 


Switch determining whether the computer 
is playing as X or 0 


Switches indicating status of search for 
excess-two and excess-three planar sit- 
uations on both offense and defense 


Switch indicating if a related pair is 
available to the opponent 


Number of l-O files in the cube under 
consideration 


Index counting number of planes of the 
same type 


Number corresponding to the move look-~ 
ahead number of the plane under consider- 
ation 


Switches indicating a TFS has been already 
found 


Number of cells in CELL2% at any particular 
time 


Indices indicating reason a lookahead for 
a planar TFS has tailed 


A,B,C DB ,1,J,K;M,N,Q,R,X,¥,42, DELTA, DUM 


Dummy variables 


- 108 = 


Array Listing 


FILENOS (448) 
FILECELIS (304) 
CELLNOS (40) 


SFIIENOS (48) 


SQFIIES (72) 
PTABLE (64) 


MX,MY (17) 


OSQ,XSQ (18) 


WATCH ,OWATCH (7 ) 


OFILE ,XFIIE (76) 


CELL2Y (12) 


List of all files in which each of 
the 64 cells is a member 


List of the four cells in each of 
the 76 files 


List of the four cells in each of 
the 10 files in a given plane 

List of all files in a given plane 
in which each of the 16 cells of the 
plane is a member 


List of four independent files in 
each of the 18 planes 


List of the 64 cells for use as a 
preset move list 


List of the offensive and defensive 


planar situations to be considered 


List of number of machine and opponent 


cells occupied in each of the 18 
planes 


List of cells in a plane which are 
XWATCH or OWATCH cells 


List of number of machine and oppon- 
ent cells occupied in each of the 
76 files 


List of all cells which are in e-0 
files of a plane under consideration 


SPOSITO ,SPOSITX (10) 


List of occupied cells by machine 
and opponent respectively, in a 
lookahead sequence in a plane under 
consideration 


~ 109 = 


POSITO, POSITX (32) 


List of occupied cells by machine 
and opponent in the overall play 


FILE29 (5) List of the 2-0 files in a plane 
under consideration 


DOFILE ,DXFIIE (10) | 
| List of number of machine and oppon- 
ent cells occupied in each of the 


10 files of a plane under consider= 
ation | 


TREE (8,10) - Array storing move possibilities 
for lookahead in TFS for a plane © 
under study | 


CIRC (7,7) _ Array storing number se types of 


planar situations available at any 
_ given time | 
STAB (75758) | Array storing number of each type. 


of planar situation Saye e 


TABIG , TABQ] (50) List of all 1-0 and. O-1 files in 


| the cube | 
TAB2Y,TABG2 (15) List of all 2-0 and 0-2 files in 
_ | the cube 
-TAB39 ,TABOS (4) List of all 3-0 and 0-3 files in 
| | the cube | 
LOOP (6) Number of each type of "x-y" file 


in the cube 


RCTABLE (16) ‘List of the 16 cells in the plane 
| under study 
- OPABLE (60); QTABLE ,OQCELLS (30) ; DOTABLE (40) ; STABIE, 


- TTABIE (7); CHK(10) 3 
Lists used for storage purposes 


The program followed by the data arrays are given - in 
the next. several pages. | 


ALG PROBL 
At GOL | 


LUCK 1 


ODIO. Per rey) 


MARCH 1001965 INTERFACE ==FFBRUARY 1591965 PASS2  DECEM3EP 23, 1944 
COMMENT THIS PROGRAM TS DESIGNED TO ALLOW THE COMPUTER TO PLAY THREE 
DIMENSIONAL TIC=-TAC=TOE AGAINST ITSELF USING PLANAR STRATEGY, 
ALL MOVES MADE BY THE OPPONENT MUST 36 SPECIFIFD KEFORE THE 
Game BEGINS-$ 
INTEGER OPPVMOWs COMPMOVe NUMXeNUMOe DELTA® DuMe “SAVETD » CNTFIL» GAME » 


NER e KeVoZeF To CHeRELPRe TRYLOTOYOeFILELUsSTABPs PLAYER. 
CNTSQe. FORCESEGs COUNT20» CNTe CNT2¢ Arto CoDo Lolo deKeMeQeRe NF 
INTEGER ARRAY FILENOS (1.2448) >» i wee 1 . 
FILECELLS4{1.2e30U) 5 PTABLE(1..64) 9 NEWMOVELL. e2U)6 
DSOOXSA(L ec R) eo TREETL. eBot eel) eWATLCH(1ee 7)» 
STABLE e TTARLE (1008) oMXeMY( 10017) eCHK(1.010)» 
JCTARLE (16.40) CELL20,SPOSI TK» SPOSITO(1 e212)» 
STILE Qu (1 ee S) eo SFILENOS(12048)* DOFILESDXFIt E10. 010)» 
RCTARLE (12.16) 9 STABUOc.e 7eNecSolLeeBde9 CIRC(Vsee7#Dee7)»® 
SUFILES(1L.¢.72)0 CELLNOS(1-¢.40)» OOCELIS(1..39)5 OWATCH(1..7)5 
POSITO*POSITX(1.634)-6 CTABLE(1..00)* QATABLE (1.230) 
OFILEs XFILE(0¢.76) 6 TARIN® TARUI(1.250), TARZO» 
TABN2(1 20615) 6 TAB30+ TAROZ( Le o4)* L9OP(1+.6)5 
SWITCH LatLAOr LAl»e LAs LASS | : 
SWITCH LH=LAUsLB1LeLB2eLB3eLB4t 
vUMP TREE* CNTSGe CELL20S _ : ~.* * 
READ(SQFILES* SFILENOS* FILENDS*FILECFLLS» CELLNOS»PTABLE eNEWMOVE + 
MX oMY)S . as 
WRITE(*COMPLETE LISTING OF DATA= INCLUDING INFORMATION IN THE LISTS.')$ 
wRITeE (#SOFILES LIST + SAFILES)S . ~ ot, : 
WRITE C*SFILENOS LIST* e+ SFILENDS)$ 
WRITE (C8EILENOS LIST*+FILENOS)S 
WRITE (CtPILECELLS LIST* oF ILECELLS)S 
WRITE (*CELLNOS LIST + CELLNOS)$S 
WRITE (*PTASLE LIST**PTAHLE)S 
WRITE C*°MX SWITCH LISTte¢Mx) > 
WRITE(C*MY SWITCH LIST'omy)s 
GAuED=USs 
NXGMe .GAWE=GAME+1$ WRITE(*wWE ARE NOW PLAYING GAME +GAVE)S 
TF GAWE FOL 160 THEN GO TO COMPLS ie 
FORCESEQ@=2US OPPMOV=US COMPMOV=NS PLAYERZ1$ . 
FUR [xol19l+¢32) DO BEGIN POSITO(1)=nS PISITX(I)=0 ENDS . | 34 
FOR Y=l001+76) DO REGIN OFILE(T)=0% XFILE(TI=) ENDS — > 
NEXTMOVE e eF OR L=l1ele6U) NO CTABLE(I)=05 
FOR Y=(ieie6)? DO FOR Y=ll*e1e1U) NO TREEC(T + J) =08 
FOR T=(i0l910) DO CHK (I) =0% 
FOR I2(191930) NO ATABLFE(I)=0% 
FOR T=(101930) DO ONCELLS(1)=05 
FOR I=(201°50) DO BEGIN TAB10(I) 20% TARNLCI)=N FNDS , Bz 
FOR [zlie1°15) 90 BEGIN TAB?PO(I)I=NS TARNe(I)=0 FNDS Bu 


#4 


E2 


ca 
a j 
Fs 


FOR Ielielesu ) 3O BEGIN TABZO0(1) 20% TABN3S(1)=0 ENDS 
TRYIZOS TRY220$ CH=TOS FT=“U0S RELPR=NS ro Y 
FOR 1=(U0eie7) DO FOR YV=(Nele7) OD FOR Kal101-8) DO 
STAB(LeUeK) Ens 
FOR T=(O0ele7) DO FOR UrlOe1907) NO CIRC(LeUI=NS 
OPOMOv=OPPYOV41S IF OPPMOv EQL 1 THEN 60 TON PRESET® 
FOR R=(2e2e64) DO IF OPPMOV EQL R THEN REGIN PLAYER=05 
 POSITO(O>PMOV/2) SNUMOS FOR IT=(1eleOPPMIV/2) DO BEGIN U=POSTTX(1)S 
POSITX(I)SPOSITO(I)S POSITO(I)SUSENDS GO TO INDEXO$ ENDS 


PLAYER=1$ FOR I=(1ele (OPPMOVE1)/2) NO BEGIN POSTTO( (OPPMOV=1)/2) =NUMOS 


J=POSITX(I)S POSITXI(T) SPOSITO(TISPOSITO(I) SU ENDS 60 TO INDEXUS 
INDEXM*e FOR I=liele76) DO BEGIN XFILE(TIANS OFILECTISN ENNS J=0$ 
INDEX1¢eurtutl1$S IF POSTTX(J) GTR O THEN BEGIN D=7«PO0SITX(U) -55 

FOR K=(1¢1907) DO BEGIN M=FILENOS(0)S XFILECMI=XFILE (M415 J=29+1 ENDS 

GO TO INDEX1 ENDS J=NS | 
INDEX? U=Ut1S IF POSITO(J) GTR O THEN BEGIN D=7«POSITO(Y) -65 

FOR K=(10107) DO BEGIN M=FILENOS(D)S OFILE(M)SOFILE(M) 415 N=N+) ENDS 

60 TO INDEX2 ENDS 

Te OPPMOV LSS 5 THEN GO TO PRESETS 

FOR I=(1e1¢°6) OO LONP(I)=05 
FOR I[=(1e1+°76) NO 
BEGIN 1° XFILE(Y) EQL O THEN 
BEGIN DUMSOFILECI) 4193 
GO TO LA(DUM) ENN ELSE 
If OFILEC(I) Eat O THEN 
BEGIN DUM=XFILECI) +15 
GO TO LB(0UM) ENDS 
LAGee GO TO ALLS 
LAL. +L00P(1)=L00P (1) 418 
K2L900°9(1)5 
TARLO(KISTIS 
60 TO ALLS 
LA2eeLOOP (2) =L00P(2) +15 
K=L90°(2)$ 
TARZ20(KI=AIS 
60 TO ALLS 
LA3* eLONP(3)=L00P(3) +15 
K=L.907(3)5$ 
TAR3SO(KISTS 
60 TO ALLS 
LBie eLOOP (4) =L00P(4) 415 
K=L00°(4U)$ 
TARBONL (KI SIS 
60 TO ALLS 
LB2eeL00P(5)=L00P(5)+1% 
K=L00°(5)$ 
TASN2S(K)I=I5 
GO TO ALLS 
LB36 eL00P (6) =L00P (6) +15 
K=L00°(6)5 
TARN3Z(KI=I9 


RE 


Ba 
37 
£7 
eR 
ER 
Be 
B4u 
Hil 
E1v 
B12 
B15 
E12 


B14 
15 
E45 


416 
tio 


£5 


= TIL - 


GO TO ALLS 
LB4.eWRITE(*THE COMPUTER “HAS LOST.*)S 
WRITE(*THE OPPONENT HAS FOUR IN A ROW IN FILE'.1)$ 
60 TO VERYS 
ALLe+M=1 END FORLOOPS , 
If tOOP(3) GIR 9 THEN GO TO MAKFS05S 
IF LO0P16) GTR THEN GO TO BLOCKO3$ 
IF LOOPt2) GTR 0 THEN GO TO TEST205 
1F LOOP(S) GTR 0 THEN GO TO TESTO2 ELSE 60 TO BUILDSOS 
MAKEN Gs DELTAS (OeTADSO LL)? 52% 
FOR Ietiels4) OO BEGIN CTABLE (I) SFILECELLS(NELTA)S 
DELTASPDELTAt1 END FORLOOPS 
J=05 
sACK2.eJUSUt15 [205 
BACKI.sI= I+1iS 
If POSTTO(Y) Ent u THEN GO TO wIN ELSE 
IF POSITO(I) EQL CTABLF(J) THEN GO TO RACK2 
€LSE GO TO BACK1IS 


_wINe eWRITE(* THE COMPUTER HAS WON AS IT HAS MANE FOURT)S | 


WRITELPIN A ROW BY MOVING TO CFELL* +CTARLE(J))S 
6O TO VERYS 
BLOCKNS, IF. LOOP(6) GTR 1 THEN . 
BEGIN WRITE(*THE COMPUTER CONCENES THE GAME. IT HOPES THE')S 
WRITE( "OPPONENT WILL GIVE IT AN OPPORTUNITY TO PLAY')S 
WRITE(" AGAINGDS 
GO To BLOCKA ENDS 
BLOCK A+ sDELTAE(W*TABUS(1))~35 
FOR YolieieY)? HO BEGIN CTABLF (ID=FILECELLS(DFLTAIS 
; DELTA=DELTA+1 ENDS | 
J=OS 
HACKY, -JzJUt15 I=0S 
HACKS. cTzIt+1S 
IF POSTTX(I) Eat uv THEN GO TO RLOCKR ELSE 
IF POSTTX(I) EQL CTABLE(J) THEN GO TO RACKY ELSE GO te: BACK35 
HLOCKRe eNUMO=CTABLE (U)S 
WRITE (* THE COMPUTER HAS BLOCKED A THREE IN A ROW 1°) 
wRITE(* BY MOVING TO CELL* e+ NIMO)S . 
GO TO NEXTMOVES 
TEST2N- -T=O0SK=05 
BACKS, eIatt+15 
IF I LEO LooP(2) THEN. 
BEGIN DELTA=S(4*TAB20(1))-35 FOR Yy=lte194) DO 
BEGIN M=UtKE CTABLE(M)=S=FILECELLS (DELTA) S$ 
DELTAZSDELTA+1 END FORLOOPS , 
=K4+4$ , : 
+ 60 TO BACKS END 
ELSE GO TO BIRDS 
SIRDe rus K-15 | 
BACKG. e J=JU415 1505 
I® CTARLE(JU) EQt 8 THEN GO TO COLT 
BACK7.eJ=I+i1$ 


Em 


B17 
E17 


£18 


E19 


B?0 


Bal 


Eel 


Ev 


voll = 


148 
149 


1450 


151 
152 
153 
154 
155 


156 


157 
158 
159 
160 
161 
162 
163 
1o4& 
165 


- 106 


167 
168 
109 
170 
171 
172 
173 
174 
175 
176 
177 
178 
179 
180 
1381 
182 


183 
184 
165 
186 


187 
188 
189 


~190 


191 
192 
193 
194 


~195 


196 
197 
198 


y 


IF POSTITO(T) Eat O THEN 
BEGIN QOTABLE(CKISCTARL ECU) K=K4+1% R22 
GO TO RACKS’ ENDS E22 
IF POSITO(T) Et CTABLE(JU) THEN GO TO RACKS ELSE GO TO BACK7S 
COLT. -J=1%5 K=2S 
BACKI1-.1F QTABLE(U) EQL ATABLE(K) THEN G9 TO RELATED ELSE K=«+415 
Ie OTARLE(K) GTR U THEN GO TO RACK11 ELSE JEJ41S K=UtH1S 
I= OTARLE(K) GTR O THEN GO TO RACK11 ELSE GO TT. REMAKES 
REMAKE*. FOR I=(1ieieG*tLO0P(2)) DO CTABLE(I)=05 
FOR I=(leole (4*LN0P(2))/2) DO REGIN NQCELLS(I) 2QTARLE(T)S B?3 
QTABLE(I)=0 ENDS tes 
IF LQOOP(5) EQL 0 THEN GO TO aeeoee 
TESTUS- -I1=05 K=NS 
BACKH. e TaI+15 
I= I LEQ LOOP(5) THEN 
B3EGIN DELTA=(4*TABN2(1))—3% FOR J=(19e1794) 70 B24 
“REGIN MEUtKS Be5 
CTABLE(M)=FILECELLS(DELTA)S 
DELTAZDELTAt1 ENDS FE 
K=K+4S GO TU BACKS ENDS E? 
VRIOLFe-J=0S K=15 
HACKO, e J=JUt15 10S 
~ fF CTABLE(Y) FOL A THEN GO TO BULLETS 
BACKINe -J=I14+1¢ 
IF POSITX(T) EQL U THEN BEGIN QTABLE (K)=CTABLE (J) B26 
K=K+1%5 GO TO RACKS ENDS E209 
IF POSTTX(I) EAL CTABLE (J) THEN GO TO RACKS ELSE GO TU BACK1INS 
RULLET.. i213 K=2% 
BACK12+«.1F QTABLE(U) FQL XTABLE(K) THEN G9 TO BACK59 FLSE K=K+41% 
. IF Q@TARLE(K) GTR U THEN GO TO RACK1I2 ELSE JeJ+15 K=UtLS 
IF ATABLE(K) GTR O THEN GO TO RACKI2 ELSE GO TO BUILDSAS 
RELATED. -NUMO=OTABLE (JS 
WRITEC*THE COMPUTER HAS FORMEN A RELATED") S 
WRITE (* PAIR AND wILL WIN ON ITS NEXT MOVE.')S 
WRITECE# IT HAS JUST MOVED TO CELL* eNiIMO)s 
| GO TO NEXTMOVES 
BACK5N- -RELPRIEQTABLE(U)S GO TO BUILDSAS 
BLOCKREL » eNUMO=RELPRS 
WRITEC*THE COMPUTER HAS BLOCKFD A POSSIBLE!) $ 
WRITE (9 RELATED PAIR BY MOVING TO CELL* + NUMD)S 
60 TO NEXTMOVES 
PRESETe. I1=1% R=4*GAME"4S J=R415 


BacK14..IF J EQL 65 THEN REGIN WRITE ("THE GAME HAS ENDED IN A TIE") Bo7 

GO TO VERY ENDS E27 
IF PTABLE (UY) EQL POSITX(L) OR PTABLE(y) EOL PAOSTITOC(I) THEN 

BEGIN JzJ+1$ I=1% GO TO BACK1I4U ENDS T=T+14% B28 


“IF PLAYER EGL 1 AND I GTR (OPPMOV=1)/2 THEN GO TO v115 ELSE 
IF PLAYER EQGL 0 AND I GTR OPPMOV/2 THEN GO TO M115 ELSE 
GO TO BACKI4S 
M115~¢. NUMO=PTABLE(J)S 
WRITE(*THE COMPUTER HAS MANE A PRESET MOVE TO CELL + eNUMO) $ 


kh = 


200 


201 | 


202 
203 
204 
205 
206 
207 
208 
209 
210 
211 


212 
213 


214 
215 
216 


217 


218 
219 
220 
221 
222 
2235 
224 
225 


ae 


226 > 
227 


228 
229 
230 


231 


232 
235 
234 
235 
236 
237 
238 


239 
240 — 
241 | 
242 - 


243 
244 


245 


246 
247 
248 
249 


GO TO NEXTMOVES 
BUILDSG. «FOR T=(101018) 00 “BEGIN 0S0(7)=05 XSQUI) 20 ENDS. 
FOR J=(lel0e18) DO BEGIN N=44J-35 FOR K=(1lelve4) DO BEGIN 
M=SQFILES(0)$ 0S014)=0SQ(4) FOF TLE (mS ‘XSQ(U)EXSQCI) #XFILE (CM) $ 
D=Nt1 END ENDS 
For 124101018) DO REGIN IF osati) LSS BR ANN XSQ(T) LSS 8 THEN BEGIN 
K=xXSQ(1)S J=OSO(TI)S CIREN Srnec enCCteh tas M=CIRC(JeK)$ | : 
STABlUsKeMI=T END ENDS 
Z=nS NEF=OS CH=0S 
OFFCHKe.az0S 27=2+1% IF 2 GTR 37 THEN GO TO 1108 
M1050.X=MX(Z)$ y=emy(2)$ If Trvi €OL 1 THEN 60 TO M111% 
Mi OB-. e 

Ir cractxey) 6TR Aa THEN GO TO M107 ELSE GO TO OFFCHKS 
MLO7> -CHSCH4L$ CHKICH)=72% IF (x-Y) LSS 3 THEN BEGIN Az A+1$ 
60 To M108 END ELSE GO TO “1125 
Mille. IF CIRC(Xe¥) GTR A THEN GO TO M112 ELSE A=0% 


-M112-.,ASAt1S STABPSSTAB(XeV¥#A)S GO TO M102 


M110-.IF RELPR GTR 0 THEN GO TO BLOCKRELS NEF=15. 2205 

ODEFCHK..a=08 7=Z+1%$ IF 2 GTR 17 THEN GO TO FUTOFFS 
X=mMx(7)$ YeMY(Z)S IF LOOP(S) GTR 6 _ AND CIRC(Y>e ay GTR A THEN 60 TO 
CHANGE ELSE GO TO DEFCHKS 

CHANGE. IF (xX-Y¥) LSS 3 THEN GO TO FUTOFF ELSE AZA+15 STABPESTABLY 9 Xr A)S 
60 TO M102S 

FUTOFF+.IF CH EQL 0 THEN GO TO PRESETS DEF=0% TRY1=1$ A=08 FT=05 

M106. .FTSET+1$ IF CHKIFT) GTR OG THEN GO TO “113% IF TRY2 EQL 1 THEN 
GO TO PRESETS TRY2=15 FI=0$ GO TO M106% 

M113..Z=CHK(FTI$ GO TO M1058 

FORCSO+ .EXE+1$ NUMO=SPOSITO(E)S WRITE ( *CONTINUATION OF FORCE 

SEQUENCE + "0S WRITE (* THE COMPUTER HAS MOVED TO CELL*+NUMO)S 

GO TO NEXTMOVES 


M1026. FOR IT=(lele7) NO BEGIN OWATCH(7)=0% WATCH(T)=0 ENDS 


FOR I=(101+40) DO NACTARLE(T)=05 
For I=(ie1010) DO BEGIN CELL20(1)=NS SPOSITX(1)=05 
' SPOSITO(I)=0 | ENDS 
N=4*STABP -3% FOR I=(401°8) DO BEGIN STABLE(I)=05 
TTABLE(1)=N ENDS FOR R=(191°4) DO REGIN 
STABLE (RISSOFILES(D)S D=D+1 ENDS 
J=0S FOR R=(10104) DO BEGIN D=4#*STARLE(R)<38 
FoR 1=(4101+4) 00 BEGIN K=Jt1IS RCTARLE(K)=SFILECELLS(D)S D=D+1 ENDS 
J=ut4a ENDS | | aa 
For Y=liele4) DO STABLE(I)=05 IF DEF EQL 1 THEN GO TO DPOSs 
SPO0S-.JU=15 K=15 
M90.eFOR I=(lelei16) DO REGIN IF POSITO(J) EGL RCTABLE(I) THEN 
BEGIN SPOSITO(K)=RCTABLE(I)S STABLE (KI=IS J=J+1$ K=K+15 
IF PosITO(y) EQ@L O THEN GO TO M91 FLSE GO TO M90 END ENDS 
J=Utis IF POSITOCU) EQL 0 THEN GO TO M91 ELSE GO Tn MONS 
M91-.J=15 K=15 
M92eeFOR I=(1iel916) DO BEGIN IF POSITx(J) EOL RCTABLE(I) THEN 
BEGIN SPOSITX(K) =RCTABLE(I)S TTABLE(KISIS J=J4+15 K=K+15 
IF PosSITX(JU) EQ@L O THEN GO TO M50 ELSE GO TO m92 END ENDS 
J=Ut1S IF POSITX(J) EQL 0 THEN GO TO M50 ELSE GO TN M92$ 
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OPOS.-..J=15 K=15 
M93eeFOR Y=liele16) DO BEGIN TF POSITX(J) EQL RCTABLE(I). THEN 
BEGIN SPOSITO(K)=RCTABLE(1)$ STABLE(KI=S=IS J=JU+15 K=K+15 
IF POSITX(U) EQ@L 0 THEN GO TO M94 ELSE GO TO M93 END ENDS 
J=J+1S IF POSITX(U) EQL 0 THEN GO TO M94 ELSE GO TO M935 
MO4e,J515 K=15 . 
M95ee¢FOR IT=(1el016) DO BEGIN IF POSITO(J) EOL RCTABLE(I) THEN 
BEGIN SPOSITX(KISRCTABLE(1I)% TTABLE(K)ISIS JSU415 K2K+15 
IF POSITO(JU) FQL U THEN GO TO M50 FLSE GO TO M95 END ENDS 
J=ZUt1S IF POSITO(U) EFEGL O THEN GO TO MSO ELSE GO Tn M955 
“M50eeFOR T=(001010) DO BEGIN DOFILE(1)=05 NXFILE(I)=0 ENDS Y=05 
M56e0<eJ=Jt1S IF STABLE(U) FOL 0 THEN GO TO M57$ 
D=3*STARLE(U)—2% FOR R=(1°0193) DO REGIN M=SFILENOS(D)S5 
— DOFILE (CM) =NOFILE(M) 41% D=D41 ENDS GO TO M565 
M57 0 eJ=NS 
M58.-J=JU+15 IF TTABLE(J) EFEQL 2 THEN GO TO. ¥595 
D=3*TTARLE(U)-25 FOR R=(1e1*°3) DO REGIN M=SFILENOS(D)S 
OXFILE (MPSNXFILE(M) 41% DO=D41i ENDS GO TD M585 
M59-eeFOR T=lleleS) DO FILE20(7)=0% J=15 
IF TRY? EQGL 1 THEN BEGIN FOR Y=(1-1°19) ON IF DOFTLE(Y) EAL 1 
ANN NXFILE(I) EQL 9 THEN BEGIN FILFIN=IS D=4*I=35 FOR J=C1lele4) DO 
BEGIN M=CELLNOS(D)$ OCTABLE (J) =RCTABLE (mM) $ D=n+1 ENDS FOR T=(iels7) 
DO IF SPOSITO(I) EQL DCTABLE(1) THEN GO TO M99 
NUMOZDCTABLE(1)5 GO TO M101$ 
M996 eNUMO=DC TABLE (2)5 
MIO01Le.WRITEC'THE COMPIITER HAS MADE A 2-0 FILE IN A PROMISING!)S 
wRITE(t SQUARE BY MOVING TO CELL ' + NiIIMO)S 
GO TO NEXTMOYE END ENDS 
TF TRY? EQL 1 THEN GO TO M106% 
FOR T=(iele10) DOO TF OXFILE(I) EQGL O AND DOFILE(TI) EQ 2 THEN REGIN 
FILE=u(U)=TS Yruti ENDS CNTFILSU-“1% IF CNTFIL EQL nA AND TRY EQL O 
THEN BEGIN 
WRITE(*® NO FORCE EXIST IN SQUARE'*?*®STABP)S GO TO CYC ENDS 
CNTSQ=1% GO TO M3% . 
M3eeKz0SFOR I=z(ielsCNTFIL) DO BEGIN O=4*FILE2n(l)<-35 
FOR Jolielse4) DO BEGIN R=JU4+KS M=CEtLNOS(D)$ 
DOCTABLE (R)SRCTABLE(M)S D=pt+l ENDS K=K+4 ENDS 
J=NS K=15 
MGeeJIJzU415 I=NS TF DCTABLE(JU) FQL 9 THEN GO TO M4O0S 
M5e¢ceI=1+1%5 IF SPOSITO(I) EQL N THEN BFGIN CELL20(K) =NCTARLE(JU)S K=K+15 
GO TO MY END §$ 
IF SPOSITO(I) EQL DCTABLE (J) THEN GO TO Ma ELSE GO TO M5$ 
MUDee J20% C=nS : ; 
M24*CNTFILS FOR I=elieleM) DO NCTARLE(I)=05 
M7lee J=U+15 IF OQCELLS(U) EQt 0 THEN GO TO MRA0S 
FOR Y=(101016) DO IF RCTABLE(I) EQ@L O@CELLS(JU) THEN BEGIN 
IF DEF ESL O THEN BEGIN 
RECNTFIL*26 FOR K=(101°R) NO REGIN IF RCTABLE (I) EOL 
CELL20(K) THEN GO TO M71 END ENDSCHC4+15 
OwATCH(CISRCTARLE(T)S GO TO M71 ENDS GO TO M715 
MBOee J=z0S C=0$ 
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M41seeJZJU+1$ IF Q@TABLE(U) EQL n THEN GO TO m6S 


FoR 1=(1+1016) 00 TF RCTABLE(I) EQL QTARBLE(J) THEN BEGIN 
IF DEF EOL 1 THEN BEGIN 
RICNTFIL®2$ FOR K=(1el1eR) HO BEGIN IF RCTABLE (1) Equ 
CELL20(K) THEN GO TO M41 END ENDSC=C+15 
WATCH(C) SRCTABLE(I)S GO TO M41 ENDS GO TO M415 __ 

M6 eCOUNT20Z2eCNTFILS 


— WRITEC*RCTABLE ' sRCTABLE)S 


WRITE (*SPOSITO*® »SPOSITO)S 

WRITE ( *SPOSTTX® eSPOSITX)S 

WRITE ( *waTCH?® »pwATCH)S 

WRITE ( *OWATCH® eOWATCH)S 
IF TRY1L E@L 1 AND OWATCH(1) GTR 0 THEN REGIN NUMOZOWATCH(1)S 
WRITE (*THE COMPUTER HAS MADE A 3-0 FILE IN HOPES OF STARTING®)$ 
wRITE(* | A FORCING SEQUENCE. IT HAS MOVED TO CELL" +NUMO)S 
GO TO NEXTMOVE ENDS 
IF TRY¥1 FQL 1 THEN GO TO M106$ 
FOR IT=le4e13016 DO BEGIN FOR JU=(1leieCOUNT2N) DO BEGIN 
IF RCTABLE(I) EQ@t CELL20(U) THEN Go TO M7 END ENDS 
GO To CNTFS 

M7ee K=CELL20(1)% R=ECELL20(2)8 CELL20(1)=CELL20(UIS 


IF JV EQL 1 OR UV EGL 3 OR UV EQ 5 OR VJ EGL 7 THEN NeJt+l1 ELSE N=J=1$ 


CELL20(2)=CELL20(N)S CELL2N(JI=KS CELL20(N)=RS 
CNTFe. IF CNTFIL LSS 2 THEN GO TO CNSQS 
| J=1S «=28 
M9eeIF CELL20(U) EGL CELL20(K) THEN Go TO DRELS K=K+1¢ 
IF CELL20(K) 6TR O THEN GO TO M9S J=Jt1$ K=JN4+15 
IF ELL20(K) GTR 0 THEN GO TO M9S 
GO TO CNSOS 
OREL» .E=xt+i$ IF DEF EQL 1 THEN GO TO NEFO3$ 
NUMO=SPOSITO(E) SFORCESEQ=1$ 
WRITE (* THE COMPUTER HAS STARTED A FORCE BY MOVING TO CELL*+NUMO)S 
WRITE ( *SPOSITX=0 SPOSITO=e TREE (CNTSQ01) =e CNT=eCNTFIL=eCNTSQ=* » 
SPOSITXs SPOSITOe TREE(CNTSQGe1) eCNT» CNTFILe CNTSQ)S 
WRITE(CELL20)3 
N=Q+1S SPOSITO(N)=CELL20(U)$ GO TO NEXTMOVES 
NEFO3. eNUMO=ZSPOSITO(E)S 
WRITEC(C*RLOCKED A POSSIBLE FORCE BY MOVING TO CELL*+NUMO)S 
GO TO NEXTMOVES 
CNSQ@-. FOR Y=(191+10) DO TREE (CNTSG+T)=CELL20(1)5 
M27eeCNT=1S Q=CNTSQ4XS 


M120 eSPOSITO(Q) =CELL20(CNT)S 


J=n$S FOR I2(001010) DO BEGIN DOFILE(T) | 20S DXFILE(IT)=0 ENDS 
M13ecJ=Ut1$ IF SPOSITO(JU). EQL O THEN GO TO M14$ 
FOR Iz(1ei1016) DO IF RCTABLE(I) EQL SPOSITO(U) 
THEN BEGIN D=3*I-26 FOR R=(101*°3) NO BEGIN M=SFILENOS(D)$ 
DOFILE (mM) =NOFILE(M) 41% O=D4+1 ENDSGO TO M13 END $ 
M14.6J=05- 
M15.eeJ=U+1$ IF SPOSITx(JU) EQL O THEN 60 TO M16S 
FOR I=(i10e1°16) DO IF RCTABLE(I) EQt SPOSITX(J) 
THEN BEGIN D=3*I1-2S FOR R=(101+3) NO BEGIN M=SFILFNOS(D)S 
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NxCLLE(MISNXFILE(M) 416 D=0+1 ENDS GO TO M15 Enns 
Ml6e5e FOR IT=(101¢05) NO FILE20(1)=-0% Joris 
FOR T=lieleidf) DO IF DOXFILECI) EQL GO AND DOOFILECI) EQL 2@ THEN 
BEGIN FILE20(UI=IS Jrd+1 ENDS CNTFIL=J-1% IF CNTFIt GTR O THEN 
GO TO RK3S CNT2=05 
ML7e eCNTICNT4+1% SPOSITO(Q)=05 IF CNT2 EQL 1 THEN REGI™ K=ECNTS9O+YS 
SPNSITX(<) 20 ENDS TF CNT GTR COUNTSO THEN GO TO RENDOS N=ECNT-$15 
FOR T=(iele1N) DO REGIN IF TREE(CNTSO+TI) GTR VU AND © 
TREE CCNTSQrI) LSS 1000 THEN BEGIN SAVETR=ITREECCNTSO0T)S 
TREE (CNTSQeT)=1000%S GO To Mi2 ENO ENDS 
rKSeeN=CNTS JZNt1S I=N"15 R=COUNT?POS K=aCNTSO+YS 
IF R EXL 2 OR R EQL 4 OR R EQL 6 OR R EQL B THEN REGEN 
IF N EQL 1 OR N EGL 3 OR N EQL 5S OP N EQGL 7 THEN BEGIN 
SPOSTTX(K) =CELL20(45)%5 GO TN M21 ENN ELSE SPOSITX(K)= CFEFLLAN(T)S 
GO TO Mei ENDS 
IF N EOL L THEN BEGIN SPOSITX(KISSAVETRS GO TO M21 ENDS 
IF N EQL 3 OR N EQL S OR N EGL 7 THEN SPOSTTX(K)=CFLL20(T) ELSE 
SPOSTTX(KISCELL20(UIE GO To M215 
M21eeTF C GTR O THEN FOR T=lieireC) DO IF DEF FQL 0 THEN IF SPOSITX(K) 
FQL waTC3(1) THEN REGIN CNT2=1% GO TO M17 FND ELSE IF SPOSTTX(K) EOL 
OWATCH(]) THEN REGIN CNT2@=7% GO TO Mi7 ENDS 
FOR J=(4101+016) DO ITF RCTABLECI) EQt SPOSITX(K) THEN BEGIN 
N=%*T=2$ FOR R =(1e1+3) DO BEGIN M=SFILENOS())4$ 
OXFILE (mM) SnxFILE (mM) +13 0-041 ENDS GO TO Mer ENDS 
Mole e J=04 
M25<e<eJ3=JU+156 IF JU GTR 10 THEN GO TON M2e5S 
IF OXFILE(U) E@L 3 AND OOFTLE( JU) EAL U THEN GO TO v24 ELSE 
GU TO “235 | 
M24eceCNT2=1% GO TO MiI7S 
M25eeFOR T=€151°19) NO CFLL20(T) US 
FOR T=liete8O) DO NCTABLE(T)=05 
K=N$ FOR T=lleteCNTFIL?)? DO BEGIN D=z4F*FILE2N(1) 35 
FOR Joltreile) DO KFEGIN R=U+KS M=ECELLNOS(D)$ 
DCT4AG _ECRISERCTABLE(M)S D=D+t1 ENDS 
K=Kt+4 ENDS 
J=NS K=15 
M26eeJS=Jt1S I=05 IF DCTABLE(J) EOL 0 THEN GO TN M335 
M32eeT=T+1H IF SPOSTTNCY) EQL GU THEN REGIN CELL2O(K) =DCTABLE(U)$S K=K+4+14% 
60 TO Mes FNDSD 
IF SPOSITO(I) EQ@L DCTARBLEC UJ) THEN GO TO Me6 ELSE GN TO M32s 
M336 eCOUNTAN=2*CNTFILS CNTSG=CNTSQt+15 
IF DEF EL 1 THEN GO TO M734 Kr1¢ 
M75ee¢TF OWATCH(K) EQL O THEN GO TO CNTFS J=1% 
M74UeeTF CELL2N( JU) EGL OWATCH(K) THEN GO T9 DRELS 
J=Ut1% IF CELL20(U) GTR 0 THEN GO TO M74 ELSE K=K+15 GO TO W755 
M730 eK=14% 
M76eeTF wATCH(K) EQL 9 THEN GO TO CNTFS J=1s 
M77eeTF CELL2N(U) EQL WATCH(K) THEN Gor TO DRELS 
J=U+is IF CELL2@0(U) GTR O THEN GO TO M77 ELSE K=K4+1% GO TO M76% 
REDO.-FOR ITE(ielel1O) DO CELL2@0(1)=05 
FOR T=(1eirelO) DO TREE(CNTS@,1)=05% 
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LET 


426 
END BLOCK 1 


M2B¢ eCNTSQ=ECNTSO-15 


IF CNTSQ@ E®L O THEN REGIN 
WRITE C* THERE IS NO CONTINUNUS FORCE IN SQUARE ' + STARP)S 
CY¥CeeTE CIRC(X*Y) GTR A AND DEF EOL O THEN GO TO M107¢ 
IF CIRC(Y*?X) GTR A AND OFF EQt 1 THEN GO TO CHANGES 
TE DFF EAL U0 THEN GO TO OFFCHK ELSE GO TO DEFCHKe ENDS 
FOR T=(1eie10) DO REGIN IF TREE(CNTSQ*I) GTR O AND > 
TREF(CNTSQelI) LSS 1000 THEN REGIN SAVETR=TREE(CNTSOs 1) 
TREE(CNTS@e1)=1000% GO TO 430 FND FNDS 
M29eeFOR T=(10e1910) DO TREE(CNTSQe1I)=NS R=CNTSQ4+XS JECNTSOFYS 
SPOSITX(J)2G% SPOSTTO(RI=0% GO TO mM28S 
M30 6 eRZCNTSOt+XS SPOSITO(R)I=0S J=CNTSQ+YS SPOSTTX(JU)=0% 
FoR Jolieie10) DO REGIN I=T+1s CELL20(JU)=TREE(CNTSO+*I)& 
IF CELL20(JU) EQ@L 1900 THEN BEGIN CELL20(U)=0¢6 GO TO M31 ENDS 
Ie CFLL20(4U) EQ@L O THEN GO TO M31 ENDS 
M31¢eCOUNT20=J-1% IF. J EQL 1 OR UV EQL 3 OR J EGL S OR J EQL 7 THEN 
J=Jt1o CNTFIL=JU/25 
GO TO M27 
VERYe. WRITE(*POSITO TARLE')S 
FOR Taliele (OPPMOV/2)) DO wRITE(POSITO(I))& 
WRITEC(C*POSITX TABLE')S 
FOR T=liele (OPPMOV/2)) DO WRITE (POSITX(1) 15 
GO TO NxSMS 
COWMPL .eFINISH 
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